-- Logs begin at Tue 2022-10-04 12:09:03 UTC, end at Tue 2022-10-04 13:07:16 UTC. -- Oct 04 12:33:27.724447 dv-cinder-860244-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 12:33:27.731824 dv-cinder-860244-1-smb devstack@keystone.service[88324]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 12:33:27 2022] *** Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: nodename: dv-cinder-860244-1-smb Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: machine: x86_64 Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: clock source: unix Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: pcre jit disabled Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: detected number of CPU cores: 4 Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: current working directory: / Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: detected binary path: /usr/bin/uwsgi-core Oct 04 12:33:27.734273 dv-cinder-860244-1-smb devstack@keystone.service[88324]: your processes number limit is 47680 Oct 04 12:33:27.734856 dv-cinder-860244-1-smb devstack@keystone.service[88324]: your memory page size is 4096 bytes Oct 04 12:33:27.734856 dv-cinder-860244-1-smb devstack@keystone.service[88324]: detected max file descriptor number: 2048 Oct 04 12:33:27.734856 dv-cinder-860244-1-smb devstack@keystone.service[88324]: lock engine: pthread robust mutexes Oct 04 12:33:27.734856 dv-cinder-860244-1-smb devstack@keystone.service[88324]: thunder lock: enabled Oct 04 12:33:27.734856 dv-cinder-860244-1-smb devstack@keystone.service[88324]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 12:33:27.734856 dv-cinder-860244-1-smb devstack@keystone.service[88324]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 12:33:27.774869 dv-cinder-860244-1-smb devstack@keystone.service[88324]: Python main interpreter initialized at 0x5597a195d9c0 Oct 04 12:33:27.774869 dv-cinder-860244-1-smb devstack@keystone.service[88324]: python threads support enabled Oct 04 12:33:27.774869 dv-cinder-860244-1-smb devstack@keystone.service[88324]: your server socket listen backlog is limited to 100 connections Oct 04 12:33:27.774869 dv-cinder-860244-1-smb devstack@keystone.service[88324]: your mercy for graceful operations on workers is 90 seconds Oct 04 12:33:27.775292 dv-cinder-860244-1-smb devstack@keystone.service[88324]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 12:33:27.775372 dv-cinder-860244-1-smb devstack@keystone.service[88324]: *** Operational MODE: preforking *** Oct 04 12:33:27.775612 dv-cinder-860244-1-smb devstack@keystone.service[88324]: *** uWSGI is running in multiple interpreter mode *** Oct 04 12:33:27.775612 dv-cinder-860244-1-smb devstack@keystone.service[88324]: spawned uWSGI master process (pid: 88324) Oct 04 12:33:27.775821 dv-cinder-860244-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 12:33:27.776784 dv-cinder-860244-1-smb devstack@keystone.service[88324]: spawned uWSGI worker 1 (pid: 88338, cores: 1) Oct 04 12:33:27.776784 dv-cinder-860244-1-smb devstack@keystone.service[88324]: spawned uWSGI worker 2 (pid: 88339, cores: 1) Oct 04 12:33:27.778237 dv-cinder-860244-1-smb devstack@keystone.service[88324]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 12:33:32.125308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 12:33:32.125308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: from cryptography.utils import int_from_bytes Oct 04 12:33:32.126148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 12:33:32.126148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: from cryptography.utils import int_from_bytes Oct 04 12:33:32.126566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 12:33:32.126566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: from cryptography.utils import int_from_bytes Oct 04 12:33:32.126676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 12:33:32.126676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: from cryptography.utils import int_from_bytes Oct 04 12:33:32.176466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 12:33:32.176658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 12:33:32.176749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 12:33:32.176837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] command line args: [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 12:33:32.176910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 12:33:32.177029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] command line args: [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 12:33:32.177106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 12:33:32.177242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ================================================================================ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 12:33:32.177321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 12:33:32.177462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ================================================================================ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 12:33:32.177540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] admin_token = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.177741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] admin_token = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.177833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] config_dir = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.177954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] config_dir = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] config_source = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] debug = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] config_source = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] debug = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.178993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.179958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_config_append = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_config_append = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_dir = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_dir = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_file = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_file = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.180969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.181982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.182894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.183048 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.183136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.183292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.183419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.183538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.183690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.183814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.183940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.184271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.184390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.30/identity {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.184511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] publish_errors = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.184622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] publish_errors = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.184739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.184857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.184974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.185094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.185207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.185318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.185434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.185564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.185717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.185833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.185945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] standard_threads = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.186063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] standard_threads = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.186182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.186305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.186418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.186535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.186654 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.186766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.186877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_journal = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_journal = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_json = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_json = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_stderr = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_stderr = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] use_syslog = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] use_syslog = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.187950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:33:32.188063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.188181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.188295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.188415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.188534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.188646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.188758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.188869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.188981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.189101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.189214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.189324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.189436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.189547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.189680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.189807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.189949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.190992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.191105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.191229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.191342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.191453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.191565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.191677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.191788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.191910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.192024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.192149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.192271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.192384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.192569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.192695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.192809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.192920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.193032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.193149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.193271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.193385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194164 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.194978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.195090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.195210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.195324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.195442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.195560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.195679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.195792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.195915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.196946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.197057 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.197168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.197290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.197404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.197517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.197682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.197799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.197911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.198035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.198149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.198260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.198372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.198491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.198603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.198791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.198913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.199943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.200987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.201953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.202910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.203970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.204129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.204246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.204368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.204489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.204602 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.204704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.204816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.204935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.205056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.205170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.205291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.205399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.205511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.205667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.205799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.205921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.206944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.207973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.208989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.209197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.209197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.209948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.210063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.210181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.210294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.210406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.210591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.210707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.210820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.210932 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.211983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.212104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.212225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.212338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.212338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.212550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.212662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.212782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.212896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.213978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.214162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.214291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.external = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.214407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.external = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.214529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.214644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.214758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.214880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.214996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.215109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.215231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.password = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.215346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.password = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.215460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] auth.token = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.215573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] auth.token = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.215686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.215799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.215920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216269 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.216963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.217077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.217191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.217313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.217429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.217544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.217683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.217801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.217915 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.218970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.219084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.219198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.219311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.219435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.219550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.219672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.219786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.219907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.220992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.221107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.221220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.221334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.221447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.221570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.221709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.221833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.221948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.222062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.222184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.222299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.222428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.222543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.222657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.222771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.222893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223008 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223122 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.223934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.224047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.224160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.224383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.224504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.224618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.224739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.224853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.224966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.225091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.225207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.225321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.225435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.225547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.225710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.225838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.225955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.226966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.227080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.227201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.227315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.227428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.227542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.227663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.227784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.227908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.228943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.229999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.230120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.230234 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.230348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.230460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.230574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.230695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.230810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.230923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.231966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.232998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.233114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.233227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.233349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.233465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.233578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.233753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.233868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.233982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.234108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.234208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.234343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.234463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.234579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.234693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.234815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.234930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.235976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.236089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.236212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.236327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.236442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.236556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.236670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.236783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.236906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237616 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.237963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.238964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.239982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.240094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.240213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.240337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.240454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.240567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.240681 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.240800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.240914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.241979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.242092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.242205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.242319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.242440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.242556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.242669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.242783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.242896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243823 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.243938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.244052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.244166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.244279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.244431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.244557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.244674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.244788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.244901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.245996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.246112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.246226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.246346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.246461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.246647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.246765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.246879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] role.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.246992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.247106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] role.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.247219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] role.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.247340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.247455 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] role.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.247575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.247690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.247805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.247919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.248962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.249076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.249189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.249302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.249424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.249539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.249668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.249783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.249898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.250925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251153 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.251976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.252154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.252273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.252387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.252502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.252616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.252730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.252852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.252967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.253082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.253230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.253347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.253460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.253580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.253716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.253829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.253942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.254903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.255886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.256502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.256618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.256740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.256845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.256958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.257071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.257186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.257305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.257427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.257542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.257754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.257871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.257997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.258112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.258235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.258351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.258464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.258579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.258692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.258806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.258928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.259995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.260957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.261072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.261187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.261311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.261428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.261543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.261672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.261789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.261904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.262946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.263991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 12:33:32.264116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.264116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:33:32.264116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 12:33:32.292144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.292319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.292471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.292553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.292628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.292703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.301006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.301198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.329607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.329771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.329857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.329965 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.384178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.384485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.433631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.433860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.434154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.434391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.593122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.593345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.593565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.593811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.594026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.594237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.594477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.594709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.594930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.595147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.595361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.595572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.618348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.618513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.618603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.618693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.618870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.618953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.619096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.619178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.619315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.619397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.619525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.619605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.619737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.619827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.631836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.632032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.644582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.644757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.644841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.644979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88339) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.645955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.646102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 12:33:32.663406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.663608 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 12:33:32.663953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.664150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 12:33:32.664424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.664601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.664686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.664811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 12:33:32.664931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.665154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.665244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.665353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 12:33:32.665654 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.665918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.666179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.666435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.674824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.675101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.675373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.675657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.676035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.676315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.676586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.676870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.683141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.684372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.686049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.686334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.686616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.686897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.687180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.687288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.687443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.687576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.687710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.687860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.687982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.688144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.688252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.688430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.688517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.688692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.688781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.688961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.689233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.689503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.689799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.690069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.712428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.713677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.713938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.714222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.715147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.715429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.718946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.719232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.719523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.720090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.720373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.720655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.726558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.726843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.727707 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.727992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.732465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.732773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.733055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.733342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.733638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.733736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.733918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.734000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.734194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.734274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.734466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.734549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.734739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.735016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.735288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.735557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.749775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.750056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.750927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.751204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.753854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.755019 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.757053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.757353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.758255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.758550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.761495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.763782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.764562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.766867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.767857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.768160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.768448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.768736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.769017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.769303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.770051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.770354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.770637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.770921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.771202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.771482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.785727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.786014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.786286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.786551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.788387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.788674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.788943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.789208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.793902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.795444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.796051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.796973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.797251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.797613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.799135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.799411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.799910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.800195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.800494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.800885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.801275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.802077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.802361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.802643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.802952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.803351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.812345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.812637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.812921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.813211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.813613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.813902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.814183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.814420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.814701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.814983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.815261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.815641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.815938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.816216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.829435 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.831522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.832359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.834991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.835802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.837243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.837906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.838909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.839193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.839358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.839596 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.840802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.841083 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.841491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.846087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.847624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.849122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.851247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.851344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.851646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.851935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.852216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.854131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.854531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.854819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.855097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.859958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.860247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.860532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.862850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.863142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.863423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.867435 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.867719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.867998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.868270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.868553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.868834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.869109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.869384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.869688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.869975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.870255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.870333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88339) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 12:33:32.870522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.870614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.870788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.870870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.871066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.871149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.871396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.871678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.871964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.872248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.872520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.872829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.873141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.873427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.873730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.873999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88339) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 12:33:32.906327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597a195d9c0 pid: 88338 (default app) Oct 04 12:33:32.909060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597a195d9c0 pid: 88339 (default app) Oct 04 12:33:32.909704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21079aa-0015-46c0-b905-0c25d6315cae None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:32.909995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21079aa-0015-46c0-b905-0c25d6315cae None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:32.910268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21079aa-0015-46c0-b905-0c25d6315cae None None] PATH_INFO: `/v3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:32.914464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 791 bytes} [Tue Oct 4 12:33:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:39.842245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0efc2d-e667-430f-ba6c-8ccd3b048e70 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:39.842764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0efc2d-e667-430f-ba6c-8ccd3b048e70 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:39.842764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0efc2d-e667-430f-ba6c-8ccd3b048e70 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:39.846950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:33:39.853112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:39.853588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:39.853758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:39.931694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: INFO dbcounter [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] Registered counter for database keystone Oct 04 12:33:39.951446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG oslo_db.sqlalchemy.engines [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:33:39.957931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writer thread running {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:33:40.138811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG passlib.handlers.bcrypt [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88338) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 12:33:40.139189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG passlib.handlers.bcrypt [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88338) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 12:33:40.197073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:40.198684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:40.325078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 12:33:40.814618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0efc2d-e667-430f-ba6c-8ccd3b048e70 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:40.885644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: INFO dbcounter [None req-5e0efc2d-e667-430f-ba6c-8ccd3b048e70 None None] Registered counter for database keystone Oct 04 12:33:40.907705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG oslo_db.sqlalchemy.engines [None req-5e0efc2d-e667-430f-ba6c-8ccd3b048e70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:33:40.914149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writer thread running {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:33:41.034551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0efc2d-e667-430f-ba6c-8ccd3b048e70 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:41.038907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2648a8-6e9b-4a02-9e3b-34066402dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:41.039542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2648a8-6e9b-4a02-9e3b-34066402dc66 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:41.039824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2648a8-6e9b-4a02-9e3b-34066402dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:41.040095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2648a8-6e9b-4a02-9e3b-34066402dc66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:41.048660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2648a8-6e9b-4a02-9e3b-34066402dc66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:41.100307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1c2648a8-6e9b-4a02-9e3b-34066402dc66 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 12:33:41.100564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2648a8-6e9b-4a02-9e3b-34066402dc66 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:41.110719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Oct 4 12:33:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 12:33:41.117270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:41.134714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03561e-5f65-4a59-ac6e-0549702e17c7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:41.139200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82cca6-3d56-4152-9081-385c2d2291e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:41.140329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82cca6-3d56-4152-9081-385c2d2291e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:41.140611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82cca6-3d56-4152-9081-385c2d2291e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:41.140885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82cca6-3d56-4152-9081-385c2d2291e2 admin admin] PATH_INFO: `/v3/projects/71839b182c07466f9bb5d0732665873b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:41.142560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82cca6-3d56-4152-9081-385c2d2291e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=71839b182c07466f9bb5d0732665873b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:41.195454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fe82cca6-3d56-4152-9081-385c2d2291e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 12:33:41.195858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82cca6-3d56-4152-9081-385c2d2291e2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:41.200567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 3/5] 10.222.0.30 () {56 vars in 1207 bytes} [Tue Oct 4 12:33:41 2022] GET /identity/v3/projects/71839b182c07466f9bb5d0732665873b => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:43.349240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806cc4-b82f-4d27-9b26-72930f39a24f None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:43.349795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806cc4-b82f-4d27-9b26-72930f39a24f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:43.349880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806cc4-b82f-4d27-9b26-72930f39a24f None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:43.354461 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 3/6] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:43.359964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a45e-08f1-4617-93e6-53006191149d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:43.360350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a45e-08f1-4617-93e6-53006191149d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:43.360515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a45e-08f1-4617-93e6-53006191149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:43.380299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-de24a45e-08f1-4617-93e6-53006191149d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:43.382366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-de24a45e-08f1-4617-93e6-53006191149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:43.390133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 12:33:43.658069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806cc4-b82f-4d27-9b26-72930f39a24f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:43.671501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806cc4-b82f-4d27-9b26-72930f39a24f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:43.675976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a57bf-218e-45ae-8819-4a9b5ea0ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:43.676618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a57bf-218e-45ae-8819-4a9b5ea0ab20 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:43.676901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a57bf-218e-45ae-8819-4a9b5ea0ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:43.677175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a57bf-218e-45ae-8819-4a9b5ea0ab20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:43.686485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a57bf-218e-45ae-8819-4a9b5ea0ab20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:43.688290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a57bf-218e-45ae-8819-4a9b5ea0ab20 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:43.697067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1324 bytes} [Tue Oct 4 12:33:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:33:43.702797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a45e-08f1-4617-93e6-53006191149d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:43.711804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a45e-08f1-4617-93e6-53006191149d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:43.716120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a9171-7c9d-43c9-bc98-553d88c09101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:43.716741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9171-7c9d-43c9-bc98-553d88c09101 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:43.717020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9171-7c9d-43c9-bc98-553d88c09101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:43.717295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a9171-7c9d-43c9-bc98-553d88c09101 admin admin] PATH_INFO: `/v3/users/e178629438714f7ca1d21caf08bb5a24` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:43.718625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a9171-7c9d-43c9-bc98-553d88c09101 admin admin] RBAC: Authorizing `identity:get_user(user_id=e178629438714f7ca1d21caf08bb5a24)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:43.720451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a9171-7c9d-43c9-bc98-553d88c09101 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:43.722016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 5/9] 10.222.0.30 () {56 vars in 1198 bytes} [Tue Oct 4 12:33:43 2022] GET /identity/v3/users/e178629438714f7ca1d21caf08bb5a24 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:45.954498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d92f-6b63-451e-b3d8-d1d396e3d7ae None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:45.955071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d92f-6b63-451e-b3d8-d1d396e3d7ae None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:45.955071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91d92f-6b63-451e-b3d8-d1d396e3d7ae None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:45.956376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:45.961851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e6b4-8811-44e0-aa60-f41bd8bd6adc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:45.962304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e6b4-8811-44e0-aa60-f41bd8bd6adc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:45.962407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e6b4-8811-44e0-aa60-f41bd8bd6adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:45.981064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a5e8e6b4-8811-44e0-aa60-f41bd8bd6adc None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:45.982313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a5e8e6b4-8811-44e0-aa60-f41bd8bd6adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:45.984034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2e280-98e6-4d81-b708-9723657af15c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:45.984364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2e280-98e6-4d81-b708-9723657af15c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:45.984647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2e280-98e6-4d81-b708-9723657af15c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:45.986065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 6/11] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:45.992714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:45.993103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:45.993251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:46.036354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG passlib.handlers.bcrypt [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88339) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 12:33:46.036736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG passlib.handlers.bcrypt [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88339) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 12:33:46.075879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:33:46.086740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:46.088354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:46.189164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:33:46.341902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8e6b4-8811-44e0-aa60-f41bd8bd6adc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:46.367455 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:46.449329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8e6b4-8811-44e0-aa60-f41bd8bd6adc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:46.451772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:46.483775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61693d9a-c748-4663-bdfa-03cf79bc8e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:46.484412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61693d9a-c748-4663-bdfa-03cf79bc8e93 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:46.484693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61693d9a-c748-4663-bdfa-03cf79bc8e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:46.484968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61693d9a-c748-4663-bdfa-03cf79bc8e93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:46.496275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61693d9a-c748-4663-bdfa-03cf79bc8e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-61693d9a-c748-4663-bdfa-03cf79bc8e93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:33:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:33:46.506678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:33:46.507769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 7/14] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:33:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:33:46.512679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61693d9a-c748-4663-bdfa-03cf79bc8e93 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:46.554036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112f54f-cfd9-4049-a4d0-a3cfba08fc67 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:46.556264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:46.591478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364403-8f64-492f-bd75-b9f026642d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:46.592420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364403-8f64-492f-bd75-b9f026642d7c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:46.592643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364403-8f64-492f-bd75-b9f026642d7c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:46.592915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d364403-8f64-492f-bd75-b9f026642d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:46.595535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:46.613908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61693d9a-c748-4663-bdfa-03cf79bc8e93 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:46.648919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:46.649545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:46.650015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:46.650290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:46.650985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:33:46.651289 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:46.652727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:46.662094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d364403-8f64-492f-bd75-b9f026642d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:46.663636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d364403-8f64-492f-bd75-b9f026642d7c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:46.665806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 8/15] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:33:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:33:46.671448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:46.760979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:33:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 12:33:46.766785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364403-8f64-492f-bd75-b9f026642d7c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:46.770295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:46.773422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0de618-1a9c-47d5-8906-8d2da96bad1b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:46.806302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6911036-a0a5-4d5e-8f1c-12c232065208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:46.806931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6911036-a0a5-4d5e-8f1c-12c232065208 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:46.807209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6911036-a0a5-4d5e-8f1c-12c232065208 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:46.807484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6911036-a0a5-4d5e-8f1c-12c232065208 None admin] PATH_INFO: `/v3/users/e178629438714f7ca1d21caf08bb5a24` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:46.808622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6911036-a0a5-4d5e-8f1c-12c232065208 None admin] RBAC: Authorizing `identity:get_user(user_id=e178629438714f7ca1d21caf08bb5a24)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:46.810107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6911036-a0a5-4d5e-8f1c-12c232065208 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:46.811656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 9/17] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:33:46 2022] GET /identity/v3/users/e178629438714f7ca1d21caf08bb5a24 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:33:46.817036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6911036-a0a5-4d5e-8f1c-12c232065208 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:46.832050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:46.870418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d364403-8f64-492f-bd75-b9f026642d7c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:46.906230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:46.907088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:46.907369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:46.907641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:46.916496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6911036-a0a5-4d5e-8f1c-12c232065208 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:46.926194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:46.928206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:33:46.946847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:33:46.947992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:33:46.948959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:33:46.948959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:33:46.948959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:33:46.948959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 9/18] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:33:46.952763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531a93-0862-4b71-9133-e2d97d1525e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:46.953480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531a93-0862-4b71-9133-e2d97d1525e9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:46.953794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531a93-0862-4b71-9133-e2d97d1525e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:46.953891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:46.954072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531a93-0862-4b71-9133-e2d97d1525e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:46.955217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b531a93-0862-4b71-9133-e2d97d1525e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:46.956692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b531a93-0862-4b71-9133-e2d97d1525e9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:46.958323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 10/19] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:33:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:46.963962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531a93-0862-4b71-9133-e2d97d1525e9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:47.010452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:47.045169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:47.056260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c0dc7-e05e-4bc0-a9d3-74bcd804b242 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:47.064902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531a93-0862-4b71-9133-e2d97d1525e9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:47.090003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f8c24-d4d9-4b42-ae61-9cb1ee39cca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:47.090617 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8c24-d4d9-4b42-ae61-9cb1ee39cca9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:47.090899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8c24-d4d9-4b42-ae61-9cb1ee39cca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:47.091167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8c24-d4d9-4b42-ae61-9cb1ee39cca9 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:47.091809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f8c24-d4d9-4b42-ae61-9cb1ee39cca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:33:47.092110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f8c24-d4d9-4b42-ae61-9cb1ee39cca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:47.093500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f8c24-d4d9-4b42-ae61-9cb1ee39cca9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:47.098076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4010a-3ead-460a-ba70-365d332b6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:47.098691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4010a-3ead-460a-ba70-365d332b6657 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:47.098979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4010a-3ead-460a-ba70-365d332b6657 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:47.099419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4010a-3ead-460a-ba70-365d332b6657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:47.100159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4010a-3ead-460a-ba70-365d332b6657 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.domain.id=default, user.id=e178629438714f7ca1d21caf08bb5a24) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:33:47.100471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4010a-3ead-460a-ba70-365d332b6657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:47.101941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4010a-3ead-460a-ba70-365d332b6657 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:47.108616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 11/20] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Oct 4 12:33:46 2022] GET /identity/v3/role_assignments?user.id=e178629438714f7ca1d21caf08bb5a24&scope.domain.id=default&role.id=b8bf66974c0448089a192ead432a35f2 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:33:47.110750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 10/21] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:33:49.380316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724c6c2-3bc6-48cb-88df-e351a717120b None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:49.381944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724c6c2-3bc6-48cb-88df-e351a717120b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:49.382425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724c6c2-3bc6-48cb-88df-e351a717120b None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:49.383968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 12/22] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:49.389639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54a0f-035c-4a5d-a57b-5896de89a415 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:49.390492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54a0f-035c-4a5d-a57b-5896de89a415 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:49.390986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54a0f-035c-4a5d-a57b-5896de89a415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:49.418764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f2c54a0f-035c-4a5d-a57b-5896de89a415 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:49.425234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f2c54a0f-035c-4a5d-a57b-5896de89a415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:49.518781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:33:49.889488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0cc5-5358-44c4-86f5-55a23267c120 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:49.889867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0cc5-5358-44c4-86f5-55a23267c120 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:49.890089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a0cc5-5358-44c4-86f5-55a23267c120 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:49.891481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:49.898160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca5471-0495-4109-903f-f7838e371f5f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:49.898826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca5471-0495-4109-903f-f7838e371f5f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:49.899302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca5471-0495-4109-903f-f7838e371f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:49.928239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a2ca5471-0495-4109-903f-f7838e371f5f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:49.929860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a2ca5471-0495-4109-903f-f7838e371f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:49.995641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:50.026674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 12/25] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:33:50.041182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87797b9b-6940-49a6-bb2c-4ac6740196e5 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:50.041467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87797b9b-6940-49a6-bb2c-4ac6740196e5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:50.041777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87797b9b-6940-49a6-bb2c-4ac6740196e5 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:50.043573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 14/26] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:50.048557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca5471-0495-4109-903f-f7838e371f5f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:50.051048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73b67-a610-4a98-937e-a21a260a95eb None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:50.051535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73b67-a610-4a98-937e-a21a260a95eb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:50.051998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73b67-a610-4a98-937e-a21a260a95eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:50.084695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9aa73b67-a610-4a98-937e-a21a260a95eb None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:50.086581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9aa73b67-a610-4a98-937e-a21a260a95eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:50.215937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 15/27] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:33:50.251425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca5471-0495-4109-903f-f7838e371f5f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:50.302177 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e486885-c70a-464e-a509-8cb211df43c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:50.303246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486885-c70a-464e-a509-8cb211df43c9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:50.303719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486885-c70a-464e-a509-8cb211df43c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:50.304202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486885-c70a-464e-a509-8cb211df43c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:50.330186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e486885-c70a-464e-a509-8cb211df43c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-4e486885-c70a-464e-a509-8cb211df43c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:33:50.337971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:33:50.338876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:33:50.339645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:33:50.342019 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 13/28] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:33:50.348174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73b67-a610-4a98-937e-a21a260a95eb None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:50.438774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:50.462508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b697-6bba-4636-b751-01fa3ed86c6a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:50.463046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b697-6bba-4636-b751-01fa3ed86c6a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:50.463046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b697-6bba-4636-b751-01fa3ed86c6a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:50.464792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 14/29] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:50.472626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424154-4a5a-4b76-8f5d-540796fa3d4c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:50.472916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424154-4a5a-4b76-8f5d-540796fa3d4c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:50.473097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89424154-4a5a-4b76-8f5d-540796fa3d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:50.481492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73b67-a610-4a98-937e-a21a260a95eb None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:50.493325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-89424154-4a5a-4b76-8f5d-540796fa3d4c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:50.495014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-89424154-4a5a-4b76-8f5d-540796fa3d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:50.546152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:50.553995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:50.555483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:50.556547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:50.558425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:50.560173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:33:50.560688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:50.565036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:50.583316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 16/30] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:33:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:50.584594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:50.617147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 15/31] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:33:50.618676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424154-4a5a-4b76-8f5d-540796fa3d4c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:50.705276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce004b7-0936-4fb2-aa22-644b2e3060f6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:50.746295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d93e2-40f8-43f9-89c8-f256fb59cfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:50.747246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d93e2-40f8-43f9-89c8-f256fb59cfa3 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:50.747720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d93e2-40f8-43f9-89c8-f256fb59cfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:50.748280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d93e2-40f8-43f9-89c8-f256fb59cfa3 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:50.749315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d93e2-40f8-43f9-89c8-f256fb59cfa3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:50.750982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d93e2-40f8-43f9-89c8-f256fb59cfa3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:50.759530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:50.760478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89424154-4a5a-4b76-8f5d-540796fa3d4c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:50.805822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:50.806906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:50.807390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:50.807862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:50.819305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:50.821392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:33:50.837892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:33:50.838787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:33:50.839567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:33:50.839567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:33:50.839567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:33:50.841335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 16/32] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:33:50.846584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:50.876657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:50.960582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739c27a-828d-44c0-a6b7-cc8e87049f7f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:50.984070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 17/33] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 4 12:33:50 2022] POST /identity/v3/roles => generated 219 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:33:50.985392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d93e2-40f8-43f9-89c8-f256fb59cfa3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:51.018974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa5710-8dc1-49d4-adf5-a37b23056cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:51.019976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa5710-8dc1-49d4-adf5-a37b23056cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.020449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa5710-8dc1-49d4-adf5-a37b23056cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.021108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa5710-8dc1-49d4-adf5-a37b23056cf7 None admin] PATH_INFO: `/v3/users/e178629438714f7ca1d21caf08bb5a24` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.023923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa5710-8dc1-49d4-adf5-a37b23056cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=e178629438714f7ca1d21caf08bb5a24)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:51.025574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa5710-8dc1-49d4-adf5-a37b23056cf7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:51.032498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 17/34] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:33:50 2022] GET /identity/v3/users/e178629438714f7ca1d21caf08bb5a24 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:51.033840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa5710-8dc1-49d4-adf5-a37b23056cf7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:51.147275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:51.183064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa5710-8dc1-49d4-adf5-a37b23056cf7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:51.227596 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d93e2-40f8-43f9-89c8-f256fb59cfa3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:51.251832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19339e6b-a776-42e3-9696-dfb4be26a130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:51.252722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339e6b-a776-42e3-9696-dfb4be26a130 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.253151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339e6b-a776-42e3-9696-dfb4be26a130 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.253570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19339e6b-a776-42e3-9696-dfb4be26a130 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.254506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19339e6b-a776-42e3-9696-dfb4be26a130 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:51.256126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19339e6b-a776-42e3-9696-dfb4be26a130 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:51.268488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:51.269415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.270504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.270504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.272001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:33:51.272115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:51.274382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:51.302750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 18/35] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:51.302750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:51.370757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:51.408644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 18/36] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 4 12:33:51 2022] POST /identity/v3/roles => generated 225 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:33:51.409974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19339e6b-a776-42e3-9696-dfb4be26a130 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:51.437626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95b555-449c-42ba-b47f-a8dd5a08c5ea None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:51.482566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb8ba-52a1-4c02-bb2e-c0fc850566b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:51.483550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb8ba-52a1-4c02-bb2e-c0fc850566b7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.483844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb8ba-52a1-4c02-bb2e-c0fc850566b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.484124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb8ba-52a1-4c02-bb2e-c0fc850566b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.485366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fb8ba-52a1-4c02-bb2e-c0fc850566b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:51.487457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fb8ba-52a1-4c02-bb2e-c0fc850566b7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:51.491768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 19/37] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:33:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:51.497729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb8ba-52a1-4c02-bb2e-c0fc850566b7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:51.542291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19339e6b-a776-42e3-9696-dfb4be26a130 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:51.585082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbad50-5b4f-427d-869d-44daf5ed445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:51.585765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbad50-5b4f-427d-869d-44daf5ed445e None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.586052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbad50-5b4f-427d-869d-44daf5ed445e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.586328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbad50-5b4f-427d-869d-44daf5ed445e None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.587001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbad50-5b4f-427d-869d-44daf5ed445e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:51.588735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbad50-5b4f-427d-869d-44daf5ed445e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:51.616795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:51.633281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 19/38] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:33:51 2022] POST /identity/v3/projects => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:33:51.634706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521c0d-3b20-4d46-b698-04fb307270b2 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.635099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521c0d-3b20-4d46-b698-04fb307270b2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.635477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32521c0d-3b20-4d46-b698-04fb307270b2 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.636931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 20/39] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:51.657010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8160a5f-ec2b-40bb-8c1b-7e8511cbb683 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.657343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8160a5f-ec2b-40bb-8c1b-7e8511cbb683 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.657556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8160a5f-ec2b-40bb-8c1b-7e8511cbb683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.688491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d8160a5f-ec2b-40bb-8c1b-7e8511cbb683 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:51.690267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d8160a5f-ec2b-40bb-8c1b-7e8511cbb683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:51.718336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb8ba-52a1-4c02-bb2e-c0fc850566b7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:51.746000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:51.760906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64091407-f94f-4705-9272-17cd00693f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:51.761668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091407-f94f-4705-9272-17cd00693f9b None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.762011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091407-f94f-4705-9272-17cd00693f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.762226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091407-f94f-4705-9272-17cd00693f9b None admin] PATH_INFO: `/v3/domains/default/users/e178629438714f7ca1d21caf08bb5a24/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.765416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64091407-f94f-4705-9272-17cd00693f9b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e178629438714f7ca1d21caf08bb5a24, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:51.767052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64091407-f94f-4705-9272-17cd00693f9b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:51.775259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:33:51.776920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285bb7-c01f-40fe-98cb-79955202156b None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.777028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285bb7-c01f-40fe-98cb-79955202156b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.777342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285bb7-c01f-40fe-98cb-79955202156b None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.783847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 22/41] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:51.785376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a12c0-227b-4de4-8ee1-b1253e897fcd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:51.785744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a12c0-227b-4de4-8ee1-b1253e897fcd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:51.786118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a12c0-227b-4de4-8ee1-b1253e897fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:51.788111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 20/42] 10.222.0.30 () {58 vars in 1361 bytes} [Tue Oct 4 12:33:51 2022] PUT /identity/v3/domains/default/users/e178629438714f7ca1d21caf08bb5a24/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:33:51.807611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-953a12c0-227b-4de4-8ee1-b1253e897fcd None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:51.809332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-953a12c0-227b-4de4-8ee1-b1253e897fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:51.901126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 23/43] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:33:52.058335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64091407-f94f-4705-9272-17cd00693f9b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:52.168593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a12c0-227b-4de4-8ee1-b1253e897fcd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:52.231285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:52.276643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a12c0-227b-4de4-8ee1-b1253e897fcd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:52.278886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64091407-f94f-4705-9272-17cd00693f9b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:52.317573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db3c5b-dda2-44e2-a18c-6caf724bbb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:52.317797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ab78a-9745-437e-8994-c32d332cb775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:52.318206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3c5b-dda2-44e2-a18c-6caf724bbb36 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:52.318317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab78a-9745-437e-8994-c32d332cb775 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:52.318494 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3c5b-dda2-44e2-a18c-6caf724bbb36 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:52.318657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab78a-9745-437e-8994-c32d332cb775 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:52.318759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3c5b-dda2-44e2-a18c-6caf724bbb36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:52.318967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab78a-9745-437e-8994-c32d332cb775 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:52.319781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ab78a-9745-437e-8994-c32d332cb775 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:52.319871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db3c5b-dda2-44e2-a18c-6caf724bbb36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:52.321177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ab78a-9745-437e-8994-c32d332cb775 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:52.321376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db3c5b-dda2-44e2-a18c-6caf724bbb36 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:52.323169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 24/44] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:33:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:33:52.328519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db3c5b-dda2-44e2-a18c-6caf724bbb36 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:52.344022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 21/45] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 4 12:33:52 2022] POST /identity/v3/roles => generated 223 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:33:52.448770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db3c5b-dda2-44e2-a18c-6caf724bbb36 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:52.478141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:52.488943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ad1c7-fc8a-44b9-81b9-7923ea13abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:52.490067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad1c7-fc8a-44b9-81b9-7923ea13abf5 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:52.490548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad1c7-fc8a-44b9-81b9-7923ea13abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:52.491012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ad1c7-fc8a-44b9-81b9-7923ea13abf5 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:52.491901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad1c7-fc8a-44b9-81b9-7923ea13abf5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:52.493637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ad1c7-fc8a-44b9-81b9-7923ea13abf5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:52.524174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 25/46] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:33:52 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:33:53.983855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e04343-bc28-4427-85c1-5c70316553de None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:53.984400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e04343-bc28-4427-85c1-5c70316553de None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:53.984400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e04343-bc28-4427-85c1-5c70316553de None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:53.985794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 22/47] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:53.992861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffbca4-9f90-4156-8152-acaa68258ba8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:53.993338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffbca4-9f90-4156-8152-acaa68258ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:53.993555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffbca4-9f90-4156-8152-acaa68258ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:54.011963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-abffbca4-9f90-4156-8152-acaa68258ba8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:54.013152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-abffbca4-9f90-4156-8152-acaa68258ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:54.080875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 26/48] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:33:54.350998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e04343-bc28-4427-85c1-5c70316553de None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:54.398246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:54.459373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e04343-bc28-4427-85c1-5c70316553de None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:54.493730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9419dd4-0e1e-4c4d-a5ab-81b0714452f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:54.494369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9419dd4-0e1e-4c4d-a5ab-81b0714452f1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:54.494651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9419dd4-0e1e-4c4d-a5ab-81b0714452f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:54.494925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9419dd4-0e1e-4c4d-a5ab-81b0714452f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:54.506235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9419dd4-0e1e-4c4d-a5ab-81b0714452f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a9419dd4-0e1e-4c4d-a5ab-81b0714452f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:33:54.511065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:33:54.511870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:33:54.512588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 23/49] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:33:54.518017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffbca4-9f90-4156-8152-acaa68258ba8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:54.621194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffbca4-9f90-4156-8152-acaa68258ba8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:54.631576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:54.657610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837e48e-b459-465e-8185-e0e4737b5fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:54.658314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e48e-b459-465e-8185-e0e4737b5fbb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:54.658597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e48e-b459-465e-8185-e0e4737b5fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:54.658871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e48e-b459-465e-8185-e0e4737b5fbb None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:54.659539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e48e-b459-465e-8185-e0e4737b5fbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:33:54.659845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e48e-b459-465e-8185-e0e4737b5fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:54.661218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e48e-b459-465e-8185-e0e4737b5fbb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:54.673141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 27/50] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:54.679893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9419dd4-0e1e-4c4d-a5ab-81b0714452f1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:54.681945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa42b44-7fa7-4585-9a53-32d56b5fedc0 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:54.682233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa42b44-7fa7-4585-9a53-32d56b5fedc0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:54.682510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa42b44-7fa7-4585-9a53-32d56b5fedc0 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:54.683810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 28/51] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:33:54.688884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de892-a7f4-462a-9520-0858afba15aa None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:54.689166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de892-a7f4-462a-9520-0858afba15aa None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:54.689434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de892-a7f4-462a-9520-0858afba15aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:54.787506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9419dd4-0e1e-4c4d-a5ab-81b0714452f1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:54.790064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:54.811573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9d3de892-a7f4-462a-9520-0858afba15aa None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:54.812783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9d3de892-a7f4-462a-9520-0858afba15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:54.823574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea6d7b-b96c-46d1-b490-d5016acdd583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:54.824217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6d7b-b96c-46d1-b490-d5016acdd583 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:54.824508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6d7b-b96c-46d1-b490-d5016acdd583 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:54.824783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea6d7b-b96c-46d1-b490-d5016acdd583 None admin] PATH_INFO: `/v3/users/e178629438714f7ca1d21caf08bb5a24` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:54.825964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea6d7b-b96c-46d1-b490-d5016acdd583 None admin] RBAC: Authorizing `identity:get_user(user_id=e178629438714f7ca1d21caf08bb5a24)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:54.827433 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea6d7b-b96c-46d1-b490-d5016acdd583 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:54.829028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 24/52] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:33:54 2022] GET /identity/v3/users/e178629438714f7ca1d21caf08bb5a24 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:54.834635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea6d7b-b96c-46d1-b490-d5016acdd583 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:54.885242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 29/53] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:33:54.933203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea6d7b-b96c-46d1-b490-d5016acdd583 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:54.967696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9f7d-25db-4d44-bd4b-c08ed83af7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:54.968327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9f7d-25db-4d44-bd4b-c08ed83af7cd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:54.968611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9f7d-25db-4d44-bd4b-c08ed83af7cd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:54.968883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9f7d-25db-4d44-bd4b-c08ed83af7cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:54.970028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9f7d-25db-4d44-bd4b-c08ed83af7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:54.971488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9f7d-25db-4d44-bd4b-c08ed83af7cd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:54.973325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 25/54] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:33:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:33:54.979358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3de892-a7f4-462a-9520-0858afba15aa None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:55.076777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:55.079854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3de892-a7f4-462a-9520-0858afba15aa None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:55.113083 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:55.113717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:55.113997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:55.114265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:55.115015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.domain.id=default, user.id=e178629438714f7ca1d21caf08bb5a24) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:33:55.115319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:55.116748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:55.125088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 30/55] 10.222.0.30 () {56 vars in 1322 bytes} [Tue Oct 4 12:33:54 2022] GET /identity/v3/role_assignments?user.id=e178629438714f7ca1d21caf08bb5a24&scope.domain.id=default&role.id=b8bf66974c0448089a192ead432a35f2 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:55.153338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9f7d-25db-4d44-bd4b-c08ed83af7cd None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:55.198059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:55.259994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9f7d-25db-4d44-bd4b-c08ed83af7cd None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:55.296922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0f50f-8f3c-4fda-9a92-79ff4e884e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:55.297568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f50f-8f3c-4fda-9a92-79ff4e884e1b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:55.297882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f50f-8f3c-4fda-9a92-79ff4e884e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:55.298160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0f50f-8f3c-4fda-9a92-79ff4e884e1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:55.299285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0f50f-8f3c-4fda-9a92-79ff4e884e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:55.300751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0f50f-8f3c-4fda-9a92-79ff4e884e1b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:55.302410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 26/56] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:55.308144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:55.409800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea9438-ae91-4489-98a8-f88d56a6206e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:55.443231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045703f1-d88a-466c-a177-0b97d7cdf7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:55.443860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045703f1-d88a-466c-a177-0b97d7cdf7c4 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:55.444142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045703f1-d88a-466c-a177-0b97d7cdf7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:55.444420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045703f1-d88a-466c-a177-0b97d7cdf7c4 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:55.445082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045703f1-d88a-466c-a177-0b97d7cdf7c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:55.446573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045703f1-d88a-466c-a177-0b97d7cdf7c4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:55.472043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 31/57] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Oct 4 12:33:55 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:33:57.645482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b4bf-63c1-4a5b-a239-db6f0da88ae5 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:57.646699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b4bf-63c1-4a5b-a239-db6f0da88ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:57.646699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6b4bf-63c1-4a5b-a239-db6f0da88ae5 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:57.648026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 27/58] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:33:57.654307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95d41-36e3-4691-ae3b-6756ec4278a6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:57.654823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95d41-36e3-4691-ae3b-6756ec4278a6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:57.654951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95d41-36e3-4691-ae3b-6756ec4278a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:57.673050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ede95d41-36e3-4691-ae3b-6756ec4278a6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:33:57.674223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ede95d41-36e3-4691-ae3b-6756ec4278a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:33:57.684737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:57.740136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 32/59] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:33:58.026611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b4bf-63c1-4a5b-a239-db6f0da88ae5 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:58.126220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6b4bf-63c1-4a5b-a239-db6f0da88ae5 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:58.135829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:33:58.160487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46ab69-bd1a-470e-a94c-b3d4c85ce388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:58.161123 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ab69-bd1a-470e-a94c-b3d4c85ce388 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:58.161434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ab69-bd1a-470e-a94c-b3d4c85ce388 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:58.161752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46ab69-bd1a-470e-a94c-b3d4c85ce388 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:58.162882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46ab69-bd1a-470e-a94c-b3d4c85ce388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:58.164342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46ab69-bd1a-470e-a94c-b3d4c85ce388 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:58.165958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 28/60] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:33:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:33:58.171675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede95d41-36e3-4691-ae3b-6756ec4278a6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:33:58.265977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede95d41-36e3-4691-ae3b-6756ec4278a6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:33:58.300117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85089309-59ab-4ac8-9205-170172a80fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:33:58.300650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089309-59ab-4ac8-9205-170172a80fbb None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:33:58.300931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089309-59ab-4ac8-9205-170172a80fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:33:58.301205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089309-59ab-4ac8-9205-170172a80fbb None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:33:58.301889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85089309-59ab-4ac8-9205-170172a80fbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:33:58.303378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85089309-59ab-4ac8-9205-170172a80fbb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:33:58.330516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 33/61] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:33:58 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:34:01.535642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7cd2-3b0e-47c0-9aa6-1f20ae646d70 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:01.536685 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7cd2-3b0e-47c0-9aa6-1f20ae646d70 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:01.537198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf7cd2-3b0e-47c0-9aa6-1f20ae646d70 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:01.539088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 29/62] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:01.544682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5e7c9-d533-49db-94b9-53f8343ef4dc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:01.545193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5e7c9-d533-49db-94b9-53f8343ef4dc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:01.545265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5e7c9-d533-49db-94b9-53f8343ef4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:01.555715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:01.570655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5bc5e7c9-d533-49db-94b9-53f8343ef4dc None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:01.571880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5bc5e7c9-d533-49db-94b9-53f8343ef4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:01.671935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 34/63] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:01.837310 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539f92-7aed-4d8a-8d4d-7efe5dc3ac45 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:01.838016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539f92-7aed-4d8a-8d4d-7efe5dc3ac45 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:01.838500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539f92-7aed-4d8a-8d4d-7efe5dc3ac45 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:01.840068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 30/64] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:01.845786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318553-fb95-4fe4-8320-a217452a3efe None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:01.846075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318553-fb95-4fe4-8320-a217452a3efe None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:01.846351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318553-fb95-4fe4-8320-a217452a3efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:01.866324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d3318553-fb95-4fe4-8320-a217452a3efe None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:01.867537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d3318553-fb95-4fe4-8320-a217452a3efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:01.961271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 35/65] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:02.079603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9539f92-7aed-4d8a-8d4d-7efe5dc3ac45 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:02.164765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab65d-36b2-4c83-a5d6-af30c39d04fa None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.165405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab65d-36b2-4c83-a5d6-af30c39d04fa None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.165933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab65d-36b2-4c83-a5d6-af30c39d04fa None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.167721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 36/66] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:02.174462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3e05-0ac7-4d0b-9596-0011fe65f54b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.174749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3e05-0ac7-4d0b-9596-0011fe65f54b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.175019 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde3e05-0ac7-4d0b-9596-0011fe65f54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.222957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-efde3e05-0ac7-4d0b-9596-0011fe65f54b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:02.225044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-efde3e05-0ac7-4d0b-9596-0011fe65f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:02.303038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9539f92-7aed-4d8a-8d4d-7efe5dc3ac45 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:02.306415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:02.320431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 37/67] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:02.352765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485edd13-625d-46bd-a95d-a15c2a1e6387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:02.353465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485edd13-625d-46bd-a95d-a15c2a1e6387 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.353789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485edd13-625d-46bd-a95d-a15c2a1e6387 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.354135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485edd13-625d-46bd-a95d-a15c2a1e6387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.366356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485edd13-625d-46bd-a95d-a15c2a1e6387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-485edd13-625d-46bd-a95d-a15c2a1e6387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:02.371446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:02.372288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:02.373014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 31/68] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:02.380641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde3e05-0ac7-4d0b-9596-0011fe65f54b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:02.517821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485edd13-625d-46bd-a95d-a15c2a1e6387 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:02.526016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde3e05-0ac7-4d0b-9596-0011fe65f54b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:02.563975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a06fb-503c-45ab-b246-2e91bde819fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:02.565287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a06fb-503c-45ab-b246-2e91bde819fe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.565751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a06fb-503c-45ab-b246-2e91bde819fe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.566170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a06fb-503c-45ab-b246-2e91bde819fe None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.567026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a06fb-503c-45ab-b246-2e91bde819fe None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:02.567532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a06fb-503c-45ab-b246-2e91bde819fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:02.569668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a06fb-503c-45ab-b246-2e91bde819fe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:02.577946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:02.580209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 38/69] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:02.581659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5691-c376-41ae-902f-4f85f9fff1f9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.582125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5691-c376-41ae-902f-4f85f9fff1f9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.582549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac5691-c376-41ae-902f-4f85f9fff1f9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.583978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 39/70] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:02.585245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5abc-febb-4521-b2fa-9f48049725c8 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.585701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5abc-febb-4521-b2fa-9f48049725c8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.586141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc5abc-febb-4521-b2fa-9f48049725c8 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.587891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 40/71] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:02.588842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc5abc-febb-4521-b2fa-9f48049725c8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:02.650078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:02.656610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485edd13-625d-46bd-a95d-a15c2a1e6387 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:02.696522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547eeda-f3fe-4269-88c8-cc733b489f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:02.697172 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547eeda-f3fe-4269-88c8-cc733b489f01 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.697462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547eeda-f3fe-4269-88c8-cc733b489f01 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.697772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547eeda-f3fe-4269-88c8-cc733b489f01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.702059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc5abc-febb-4521-b2fa-9f48049725c8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:02.709562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547eeda-f3fe-4269-88c8-cc733b489f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d547eeda-f3fe-4269-88c8-cc733b489f01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:02.714475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:02.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:02.716062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 32/72] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:02.721731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94a9e6-aee9-438e-91b6-216ad70d63db None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.722029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94a9e6-aee9-438e-91b6-216ad70d63db None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.722307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94a9e6-aee9-438e-91b6-216ad70d63db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.741629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3a94a9e6-aee9-438e-91b6-216ad70d63db None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:02.742215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a678d-db97-4c3c-bf67-5ee1800203fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:02.742867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a678d-db97-4c3c-bf67-5ee1800203fd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.743153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a678d-db97-4c3c-bf67-5ee1800203fd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.743254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3a94a9e6-aee9-438e-91b6-216ad70d63db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:02.743466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a678d-db97-4c3c-bf67-5ee1800203fd None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.761350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a678d-db97-4c3c-bf67-5ee1800203fd None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:02.762859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a678d-db97-4c3c-bf67-5ee1800203fd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:02.769003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 41/73] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:02 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:02.769003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250a814-785b-4d6c-861a-6038acc31105 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:02.769003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250a814-785b-4d6c-861a-6038acc31105 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:02.769003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250a814-785b-4d6c-861a-6038acc31105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:02.786329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0250a814-785b-4d6c-861a-6038acc31105 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:02.788067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0250a814-785b-4d6c-861a-6038acc31105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:02.819287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 33/74] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:02.820380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94a9e6-aee9-438e-91b6-216ad70d63db None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:02.858091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:02.905820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 42/75] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:02.908017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250a814-785b-4d6c-861a-6038acc31105 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:02.951126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94a9e6-aee9-438e-91b6-216ad70d63db None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:02.986758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:03.015338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.016735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.017388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.018128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.019604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:03.020321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:03.023848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:03.039336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 34/76] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:03.041018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:03.096463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250a814-785b-4d6c-861a-6038acc31105 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.155987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae57b4-a6b5-4f2c-b3b6-287205a68f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.157278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae57b4-a6b5-4f2c-b3b6-287205a68f38 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.157974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae57b4-a6b5-4f2c-b3b6-287205a68f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.158661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae57b4-a6b5-4f2c-b3b6-287205a68f38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.197448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:03.215236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545924e-b17c-4ee2-aa80-d98175af24d4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.251466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae57b4-a6b5-4f2c-b3b6-287205a68f38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:03.252563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db631898-c21d-46e8-8ba4-90be5f5f726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.252946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae57b4-a6b5-4f2c-b3b6-287205a68f38 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:03.253563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631898-c21d-46e8-8ba4-90be5f5f726f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.254014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631898-c21d-46e8-8ba4-90be5f5f726f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.254434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db631898-c21d-46e8-8ba4-90be5f5f726f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.271435 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db631898-c21d-46e8-8ba4-90be5f5f726f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-db631898-c21d-46e8-8ba4-90be5f5f726f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:03.276749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:03.277621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:03.278678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 35/77] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:03.279290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db631898-c21d-46e8-8ba4-90be5f5f726f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:03.306701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:03.368538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 43/78] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:03.369316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae57b4-a6b5-4f2c-b3b6-287205a68f38 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:03.400274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db631898-c21d-46e8-8ba4-90be5f5f726f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.445784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4add-c90d-48b0-93f9-3a25b46dbeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.446445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4add-c90d-48b0-93f9-3a25b46dbeb0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.446736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4add-c90d-48b0-93f9-3a25b46dbeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.447015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4add-c90d-48b0-93f9-3a25b46dbeb0 None admin] PATH_INFO: `/v3/users/e178629438714f7ca1d21caf08bb5a24` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.448255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af4add-c90d-48b0-93f9-3a25b46dbeb0 None admin] RBAC: Authorizing `identity:get_user(user_id=e178629438714f7ca1d21caf08bb5a24)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:03.449784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af4add-c90d-48b0-93f9-3a25b46dbeb0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:03.451425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 36/79] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:03 2022] GET /identity/v3/users/e178629438714f7ca1d21caf08bb5a24 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:03.452302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4add-c90d-48b0-93f9-3a25b46dbeb0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:03.474759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:03.490039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae57b4-a6b5-4f2c-b3b6-287205a68f38 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.526689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ed6e-efe1-4305-b88d-fac2715bce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.527397 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ed6e-efe1-4305-b88d-fac2715bce39 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.527775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ed6e-efe1-4305-b88d-fac2715bce39 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.528151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ed6e-efe1-4305-b88d-fac2715bce39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.529839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ed6e-efe1-4305-b88d-fac2715bce39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:03.531629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ed6e-efe1-4305-b88d-fac2715bce39 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:03.533514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 44/80] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:03.534872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ed6e-efe1-4305-b88d-fac2715bce39 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:03.560471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:03.571326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4add-c90d-48b0-93f9-3a25b46dbeb0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.606782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.607567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.607691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.607953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.608620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:03.608936 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:03.610397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:03.619156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 37/81] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:03.619997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:03.659847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ed6e-efe1-4305-b88d-fac2715bce39 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.696634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d58ff-2bd6-4b8d-a3ad-be4f47a7c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.697278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d58ff-2bd6-4b8d-a3ad-be4f47a7c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.697561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d58ff-2bd6-4b8d-a3ad-be4f47a7c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.697872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d58ff-2bd6-4b8d-a3ad-be4f47a7c9a8 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.699018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d58ff-2bd6-4b8d-a3ad-be4f47a7c9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:03.700510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d58ff-2bd6-4b8d-a3ad-be4f47a7c9a8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:03.702189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 45/82] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:03 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:03.704294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:03.707943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d58ff-2bd6-4b8d-a3ad-be4f47a7c9a8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:03.727760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a3384-0027-474d-9db1-3fd8c2652256 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.762869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e648792-7273-4a13-984a-45369a159656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.763528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e648792-7273-4a13-984a-45369a159656 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.763804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e648792-7273-4a13-984a-45369a159656 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.764083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e648792-7273-4a13-984a-45369a159656 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.776376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e648792-7273-4a13-984a-45369a159656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-4e648792-7273-4a13-984a-45369a159656 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:03.783493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:03.784379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:03.785325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 38/83] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:03.786433 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e648792-7273-4a13-984a-45369a159656 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:03.794095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:03.821067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d58ff-2bd6-4b8d-a3ad-be4f47a7c9a8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.861971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef6dea-546e-4165-b875-10dd7b10c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.862610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6dea-546e-4165-b875-10dd7b10c254 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.862884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6dea-546e-4165-b875-10dd7b10c254 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.863161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef6dea-546e-4165-b875-10dd7b10c254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.899275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e648792-7273-4a13-984a-45369a159656 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:03.935146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678a043-8495-494b-902d-61072071ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:03.935768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678a043-8495-494b-902d-61072071ff81 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:03.936076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678a043-8495-494b-902d-61072071ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:03.936403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678a043-8495-494b-902d-61072071ff81 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:03.937069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678a043-8495-494b-902d-61072071ff81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:03.938566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678a043-8495-494b-902d-61072071ff81 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:03.954922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:03.956607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef6dea-546e-4165-b875-10dd7b10c254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:03.960373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef6dea-546e-4165-b875-10dd7b10c254 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:03.971589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 39/84] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:34:03 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:34:03.972491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678a043-8495-494b-902d-61072071ff81 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:04.077496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:04.110790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 46/85] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:04.111810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef6dea-546e-4165-b875-10dd7b10c254 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:04.117232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678a043-8495-494b-902d-61072071ff81 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:04.160042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072b85-fcda-41cb-af57-b7409a84633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:04.160716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072b85-fcda-41cb-af57-b7409a84633e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:04.161016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072b85-fcda-41cb-af57-b7409a84633e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:04.161335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072b85-fcda-41cb-af57-b7409a84633e None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:04.162637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac072b85-fcda-41cb-af57-b7409a84633e None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:04.164172 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac072b85-fcda-41cb-af57-b7409a84633e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:04.165912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 40/86] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:03 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:04.166726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072b85-fcda-41cb-af57-b7409a84633e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:04.253422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:04.264505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef6dea-546e-4165-b875-10dd7b10c254 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:04.323329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:04.324777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:04.325203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:04.325578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:04.326477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] RBAC: Adding query filter params (role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099, user.id=d75ad6ea00ed490582ccc4fdb2bdd495) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:04.326908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:04.328605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:04.329071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072b85-fcda-41cb-af57-b7409a84633e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:04.337588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 47/87] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:04 2022] GET /identity/v3/role_assignments?user.id=d75ad6ea00ed490582ccc4fdb2bdd495&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:04.339597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:04.405939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:04.406901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:04.407367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:04.407822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:04.408780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:04.409299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:04.411026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:04.426679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:04.426811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 41/88] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:04.430854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:04.552740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49072890-54a2-4cf4-a085-0a225c9735c6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:04.604898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e071c-c416-4f9c-a9f5-93255ab97460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:04.605583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e071c-c416-4f9c-a9f5-93255ab97460 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:04.605926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e071c-c416-4f9c-a9f5-93255ab97460 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:04.606199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e071c-c416-4f9c-a9f5-93255ab97460 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:04.607806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e071c-c416-4f9c-a9f5-93255ab97460 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:04.609376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e071c-c416-4f9c-a9f5-93255ab97460 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:04.615448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 48/89] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:04 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:04.617668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e071c-c416-4f9c-a9f5-93255ab97460 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:04.629655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d3210-4af6-458b-8491-01c595eddaa3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:04.690606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:04.714715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58bae2-9c3e-473d-8ed7-148ed9e3b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:04.716605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58bae2-9c3e-473d-8ed7-148ed9e3b82b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:04.717381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58bae2-9c3e-473d-8ed7-148ed9e3b82b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:04.718391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58bae2-9c3e-473d-8ed7-148ed9e3b82b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:04.831603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e071c-c416-4f9c-a9f5-93255ab97460 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:04.861487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:04.908194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58bae2-9c3e-473d-8ed7-148ed9e3b82b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:04.910622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58bae2-9c3e-473d-8ed7-148ed9e3b82b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:04.936841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fcb02-29ad-48e9-be02-8d57ab2fec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:04.937638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fcb02-29ad-48e9-be02-8d57ab2fec55 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:04.937923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fcb02-29ad-48e9-be02-8d57ab2fec55 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:04.938201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fcb02-29ad-48e9-be02-8d57ab2fec55 None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:04.940148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fcb02-29ad-48e9-be02-8d57ab2fec55 None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:04.941908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fcb02-29ad-48e9-be02-8d57ab2fec55 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:04.947382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 49/90] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:04 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:04.948475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fcb02-29ad-48e9-be02-8d57ab2fec55 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:05.209749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fcb02-29ad-48e9-be02-8d57ab2fec55 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:05.272291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 42/91] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 847 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:05.274636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58bae2-9c3e-473d-8ed7-148ed9e3b82b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:05.344817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:05.346370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:05.347542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:05.349674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:05.351341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099, user.id=e178629438714f7ca1d21caf08bb5a24) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:05.352189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:05.353638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:05.357992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:05.370918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 50/92] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:04 2022] GET /identity/v3/role_assignments?user.id=e178629438714f7ca1d21caf08bb5a24&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=b8bf66974c0448089a192ead432a35f2 => generated 259 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:05.372954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:05.468793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:05.570898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58bae2-9c3e-473d-8ed7-148ed9e3b82b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:05.591698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c20f26-1664-4262-81f0-cfad1c859f9f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:05.658470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337319ae-2bf5-4ea8-ac7d-40653f2e3112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:05.659118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337319ae-2bf5-4ea8-ac7d-40653f2e3112 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:05.659483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337319ae-2bf5-4ea8-ac7d-40653f2e3112 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:05.659716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337319ae-2bf5-4ea8-ac7d-40653f2e3112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:05.669505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116f17-ba8e-4d9e-ab92-3aa746628912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:05.671192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116f17-ba8e-4d9e-ab92-3aa746628912 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:05.672389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116f17-ba8e-4d9e-ab92-3aa746628912 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:05.673189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7116f17-ba8e-4d9e-ab92-3aa746628912 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:05.675878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7116f17-ba8e-4d9e-ab92-3aa746628912 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:05.679916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7116f17-ba8e-4d9e-ab92-3aa746628912 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:05.684055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 51/93] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:05 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:05.691881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116f17-ba8e-4d9e-ab92-3aa746628912 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:05.849671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337319ae-2bf5-4ea8-ac7d-40653f2e3112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:05.851676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337319ae-2bf5-4ea8-ac7d-40653f2e3112 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:05.921962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:05.934697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7116f17-ba8e-4d9e-ab92-3aa746628912 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:05.958893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:06.039150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:06.040189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:06.040641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:06.041121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:06.042520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] RBAC: Adding query filter params (role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099, user.id=d75ad6ea00ed490582ccc4fdb2bdd495) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:06.043075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:06.048005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:06.078363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 52/94] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:05 2022] GET /identity/v3/role_assignments?user.id=d75ad6ea00ed490582ccc4fdb2bdd495&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=0adab6046ed34edf8914c4971198655f => generated 259 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:06.119304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 43/95] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:06.126719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:06.277361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e2a79-cfe2-4edd-aeb2-3268c3abd232 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:06.325634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190db129-1448-49b7-9ab5-b45586207ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:06.326326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190db129-1448-49b7-9ab5-b45586207ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:06.326619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190db129-1448-49b7-9ab5-b45586207ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:06.326903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190db129-1448-49b7-9ab5-b45586207ce9 None admin] PATH_INFO: `/v3/projects/00c4cf900fe14c53bac59d9fccfbb721` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:06.334645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190db129-1448-49b7-9ab5-b45586207ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=00c4cf900fe14c53bac59d9fccfbb721)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:06.336224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190db129-1448-49b7-9ab5-b45586207ce9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:06.338492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 53/96] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:06 2022] GET /identity/v3/projects/00c4cf900fe14c53bac59d9fccfbb721 => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:06.344783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337319ae-2bf5-4ea8-ac7d-40653f2e3112 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:06.522313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337319ae-2bf5-4ea8-ac7d-40653f2e3112 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:06.566577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:06.578416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82ad22-0628-4f50-9782-6366fe7ccbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:06.579075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82ad22-0628-4f50-9782-6366fe7ccbbc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:06.579366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82ad22-0628-4f50-9782-6366fe7ccbbc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:06.579651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82ad22-0628-4f50-9782-6366fe7ccbbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:06.580420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82ad22-0628-4f50-9782-6366fe7ccbbc None admin] RBAC: Adding query filter params (role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=00c4cf900fe14c53bac59d9fccfbb721, user.id=d75ad6ea00ed490582ccc4fdb2bdd495) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:06.580740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82ad22-0628-4f50-9782-6366fe7ccbbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:06.582316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82ad22-0628-4f50-9782-6366fe7ccbbc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:06.589394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 44/97] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:06 2022] GET /identity/v3/role_assignments?user.id=d75ad6ea00ed490582ccc4fdb2bdd495&scope.project.id=00c4cf900fe14c53bac59d9fccfbb721&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:07.460540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26b82-c489-4786-ab8f-f30d6710e54d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:07.461244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26b82-c489-4786-ab8f-f30d6710e54d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:07.461244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26b82-c489-4786-ab8f-f30d6710e54d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:07.462942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 54/98] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:07.469348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1b75-1e8a-4baf-8146-1a247e33d7f6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:07.470066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1b75-1e8a-4baf-8146-1a247e33d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:07.470066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1b75-1e8a-4baf-8146-1a247e33d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:07.500198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6bea1b75-1e8a-4baf-8146-1a247e33d7f6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:07.501512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6bea1b75-1e8a-4baf-8146-1a247e33d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:07.529323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb450-57ae-4f0b-b452-0acdbb701be4 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:07.529698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb450-57ae-4f0b-b452-0acdbb701be4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:07.529913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb450-57ae-4f0b-b452-0acdbb701be4 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:07.532648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 55/99] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:07.545540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591cdc1-dd99-4f42-ac30-fa6f050ca490 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:07.546089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591cdc1-dd99-4f42-ac30-fa6f050ca490 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:07.546390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591cdc1-dd99-4f42-ac30-fa6f050ca490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:07.581186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3591cdc1-dd99-4f42-ac30-fa6f050ca490 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:07.582590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3591cdc1-dd99-4f42-ac30-fa6f050ca490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:07.650834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:07.656429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 45/100] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:07.701186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 56/101] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:07.968195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63370-978c-4893-b0e8-3acd5bd9e067 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:07.968548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63370-978c-4893-b0e8-3acd5bd9e067 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:07.968716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb63370-978c-4893-b0e8-3acd5bd9e067 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:07.970137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 46/102] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:07.986349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9376-3f5c-4774-b5d8-6c29897d668d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:07.986643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9376-3f5c-4774-b5d8-6c29897d668d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:07.986903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c9376-3f5c-4774-b5d8-6c29897d668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:08.014914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5b5c9376-3f5c-4774-b5d8-6c29897d668d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:08.016185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5b5c9376-3f5c-4774-b5d8-6c29897d668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:08.059177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63370-978c-4893-b0e8-3acd5bd9e067 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:08.126876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 57/103] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:08.184718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c9376-3f5c-4774-b5d8-6c29897d668d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:08.272990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb63370-978c-4893-b0e8-3acd5bd9e067 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:08.305986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:08.331224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726927-4abd-44e8-b8c1-13ba251c1ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:08.332032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726927-4abd-44e8-b8c1-13ba251c1ec6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:08.332322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726927-4abd-44e8-b8c1-13ba251c1ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:08.332598 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726927-4abd-44e8-b8c1-13ba251c1ec6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:08.351709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da726927-4abd-44e8-b8c1-13ba251c1ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-da726927-4abd-44e8-b8c1-13ba251c1ec6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:08.360969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:08.361872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:08.362639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 47/104] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:08.372114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726927-4abd-44e8-b8c1-13ba251c1ec6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:08.439367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c9376-3f5c-4774-b5d8-6c29897d668d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:08.441929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:08.503422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1233ca-1509-4c1d-8c44-413c9bdea129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:08.504287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1233ca-1509-4c1d-8c44-413c9bdea129 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:08.504388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1233ca-1509-4c1d-8c44-413c9bdea129 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:08.504638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1233ca-1509-4c1d-8c44-413c9bdea129 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:08.506430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1233ca-1509-4c1d-8c44-413c9bdea129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:08.507938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1233ca-1509-4c1d-8c44-413c9bdea129 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:08.509583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 58/105] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:08.514608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1233ca-1509-4c1d-8c44-413c9bdea129 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:08.549875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726927-4abd-44e8-b8c1-13ba251c1ec6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:08.623913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:08.624557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:08.624855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:08.625110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:08.625934 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:08.626243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:08.627788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:08.642793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1233ca-1509-4c1d-8c44-413c9bdea129 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:08.647040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 48/106] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:08.647664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:08.684271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb9ab9-329a-48dd-b39d-919848096da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:08.684923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9ab9-329a-48dd-b39d-919848096da8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:08.685211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9ab9-329a-48dd-b39d-919848096da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:08.685488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9ab9-329a-48dd-b39d-919848096da8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:08.696690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb9ab9-329a-48dd-b39d-919848096da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-12eb9ab9-329a-48dd-b39d-919848096da8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:08.701626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:08.702492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:08.703248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 59/107] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:08.703855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb9ab9-329a-48dd-b39d-919848096da8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:08.727968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:08.738301 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:08.808979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb9ab9-329a-48dd-b39d-919848096da8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:08.844784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e5c2b-d669-442b-b91a-4e90ef1aac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:08.845618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e5c2b-d669-442b-b91a-4e90ef1aac1e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:08.845942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e5c2b-d669-442b-b91a-4e90ef1aac1e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:08.846226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e5c2b-d669-442b-b91a-4e90ef1aac1e None admin] PATH_INFO: `/v3/users/2c7a453044c94b0faa1c8e94bfeb0c10` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:08.858466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ffdb2-2974-49fd-a260-66db79ebaa24 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:08.861103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e5c2b-d669-442b-b91a-4e90ef1aac1e None admin] RBAC: Authorizing `identity:get_user(user_id=2c7a453044c94b0faa1c8e94bfeb0c10)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:08.862635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e5c2b-d669-442b-b91a-4e90ef1aac1e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:08.865250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 60/108] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:08 2022] GET /identity/v3/users/2c7a453044c94b0faa1c8e94bfeb0c10 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:08.870279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e5c2b-d669-442b-b91a-4e90ef1aac1e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:08.929587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c184a-b6c6-4fcb-8e5a-8dfd9fec5cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:08.930317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c184a-b6c6-4fcb-8e5a-8dfd9fec5cee None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:08.930643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c184a-b6c6-4fcb-8e5a-8dfd9fec5cee None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:08.930956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c184a-b6c6-4fcb-8e5a-8dfd9fec5cee None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:08.931626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c184a-b6c6-4fcb-8e5a-8dfd9fec5cee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:08.933805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c184a-b6c6-4fcb-8e5a-8dfd9fec5cee None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:08.976960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 49/109] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:34:08 2022] POST /identity/v3/projects => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:34:08.977884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c184a-b6c6-4fcb-8e5a-8dfd9fec5cee None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:09.021150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:09.043914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e5c2b-d669-442b-b91a-4e90ef1aac1e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:09.128011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:09.128649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.128936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.129213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.130467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:09.130778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:09.133723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:09.155512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 61/110] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:09.162046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:09.162677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:09.177851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c184a-b6c6-4fcb-8e5a-8dfd9fec5cee None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:09.281680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab7cae-9375-46cb-9b1b-644b7e0f40d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:09.282318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab7cae-9375-46cb-9b1b-644b7e0f40d4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.282603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab7cae-9375-46cb-9b1b-644b7e0f40d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.282879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab7cae-9375-46cb-9b1b-644b7e0f40d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.388647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d7e30-23c1-4411-a60f-43ad8acb5a63 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:09.415012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab7cae-9375-46cb-9b1b-644b7e0f40d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:09.416728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab7cae-9375-46cb-9b1b-644b7e0f40d4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:09.441864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c7140-dc0f-4c81-9e87-9f1138d21730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:09.442597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c7140-dc0f-4c81-9e87-9f1138d21730 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.442886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c7140-dc0f-4c81-9e87-9f1138d21730 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.443164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c7140-dc0f-4c81-9e87-9f1138d21730 None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.444515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c7140-dc0f-4c81-9e87-9f1138d21730 None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:09.446498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c7140-dc0f-4c81-9e87-9f1138d21730 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:09.448197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 62/111] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:09 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:09.450844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0c35a-a100-4fdd-b004-bd8d210c3f47 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.451319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0c35a-a100-4fdd-b004-bd8d210c3f47 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.451742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0c35a-a100-4fdd-b004-bd8d210c3f47 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.453232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 63/112] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:09.457343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0c35a-a100-4fdd-b004-bd8d210c3f47 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:09.491133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:09.550208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:09.561956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 50/113] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:09.563261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7da19-cf24-4fc7-80f7-032438d3ba99 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.563692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7da19-cf24-4fc7-80f7-032438d3ba99 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.564073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7da19-cf24-4fc7-80f7-032438d3ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.589589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-10c7da19-cf24-4fc7-80f7-032438d3ba99 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:09.591034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-10c7da19-cf24-4fc7-80f7-032438d3ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:09.608942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0c35a-a100-4fdd-b004-bd8d210c3f47 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:09.653629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bc5b9-2788-4087-bacc-b85fefeebb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:09.654474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc5b9-2788-4087-bacc-b85fefeebb33 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.654763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc5b9-2788-4087-bacc-b85fefeebb33 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.655067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc5b9-2788-4087-bacc-b85fefeebb33 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.656450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bc5b9-2788-4087-bacc-b85fefeebb33 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:09.658689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bc5b9-2788-4087-bacc-b85fefeebb33 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:09.660988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 64/114] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:09 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:09.667374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c1c8-5002-4b63-a5c2-a68a44493342 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.668987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c1c8-5002-4b63-a5c2-a68a44493342 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.669266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6c1c8-5002-4b63-a5c2-a68a44493342 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.670912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 65/115] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:09.671507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6c1c8-5002-4b63-a5c2-a68a44493342 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:09.675955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 51/116] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:09.678721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7da19-cf24-4fc7-80f7-032438d3ba99 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:09.817443 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:09.838360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6c1c8-5002-4b63-a5c2-a68a44493342 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:09.898382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7da19-cf24-4fc7-80f7-032438d3ba99 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:09.900433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b46142-ebaf-430b-879d-7d9f1e9af297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:09.901082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46142-ebaf-430b-879d-7d9f1e9af297 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.901362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46142-ebaf-430b-879d-7d9f1e9af297 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.901664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46142-ebaf-430b-879d-7d9f1e9af297 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.903939 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b46142-ebaf-430b-879d-7d9f1e9af297 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:09.904649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b46142-ebaf-430b-879d-7d9f1e9af297 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:09.906766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 66/117] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:09 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:09.908103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aaad1-4ad0-4398-9510-23bd137e7e0e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.908391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aaad1-4ad0-4398-9510-23bd137e7e0e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.908666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aaad1-4ad0-4398-9510-23bd137e7e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.932023 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:09.933794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-aa1aaad1-4ad0-4398-9510-23bd137e7e0e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:09.935632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-aa1aaad1-4ad0-4398-9510-23bd137e7e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:09.951321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe6e3c-b266-49bb-a7bd-4ee22aa0b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:09.952465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe6e3c-b266-49bb-a7bd-4ee22aa0b744 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.953121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe6e3c-b266-49bb-a7bd-4ee22aa0b744 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.953575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe6e3c-b266-49bb-a7bd-4ee22aa0b744 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/users/d75ad6ea00ed490582ccc4fdb2bdd495/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.956771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe6e3c-b266-49bb-a7bd-4ee22aa0b744 None admin] RBAC: Authorizing `identity:create_grant(project_id=f289526ed98a4fe38c3ad61be0ecd099, user_id=d75ad6ea00ed490582ccc4fdb2bdd495, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:09.960218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe6e3c-b266-49bb-a7bd-4ee22aa0b744 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:09.988066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 52/118] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:09 2022] PUT /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/users/d75ad6ea00ed490582ccc4fdb2bdd495/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:09.992145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9019895-6587-4c7b-a218-5b1ec196022a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:09.992725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9019895-6587-4c7b-a218-5b1ec196022a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:09.993276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9019895-6587-4c7b-a218-5b1ec196022a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:09.999255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 53/119] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:10.000802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9019895-6587-4c7b-a218-5b1ec196022a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:10.039050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 67/120] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:10.045642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3754-7f0a-4ad7-b22e-65e1faf94a38 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:10.046544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3754-7f0a-4ad7-b22e-65e1faf94a38 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:10.047082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3754-7f0a-4ad7-b22e-65e1faf94a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:10.084897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5a5f3754-7f0a-4ad7-b22e-65e1faf94a38 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:10.086638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5a5f3754-7f0a-4ad7-b22e-65e1faf94a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:10.168669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9019895-6587-4c7b-a218-5b1ec196022a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:10.213589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:10.214276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:10.214608 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:10.214817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:10.215671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] RBAC: Adding query filter params (role.id=1bf206c740ba4f59b66a1cc010f7aee9, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099, user.id=2c7a453044c94b0faa1c8e94bfeb0c10) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:10.215986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:10.217478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:10.224900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 54/121] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:09 2022] GET /identity/v3/role_assignments?user.id=2c7a453044c94b0faa1c8e94bfeb0c10&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=1bf206c740ba4f59b66a1cc010f7aee9 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:10.225385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:10.230657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 68/122] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:10.310775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:10.393980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d47b8-c219-4b21-977a-58cbce029034 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:10.447247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91db63-ed6a-45fe-9d94-e5528f77c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:10.447948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91db63-ed6a-45fe-9d94-e5528f77c044 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:10.448232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91db63-ed6a-45fe-9d94-e5528f77c044 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:10.448507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91db63-ed6a-45fe-9d94-e5528f77c044 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:10.464252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91db63-ed6a-45fe-9d94-e5528f77c044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-fb91db63-ed6a-45fe-9d94-e5528f77c044 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:10.469628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:10.470491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:10.471401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 55/123] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:34:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:10.482755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f3754-7f0a-4ad7-b22e-65e1faf94a38 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:10.504961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:10.567784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91db63-ed6a-45fe-9d94-e5528f77c044 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:10.610406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f3754-7f0a-4ad7-b22e-65e1faf94a38 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:10.651393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:10.652542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:10.652837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:10.653114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:10.654192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:10.654502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:10.655934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:10.666740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 69/124] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:10.672818 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:10.816375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7370b13-1902-47fe-afe2-02a768cd293a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:10.819614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91db63-ed6a-45fe-9d94-e5528f77c044 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:10.833452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:10.835485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:10.855002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdd918-6b70-4ac3-aab1-b671f129ebef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:10.855655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdd918-6b70-4ac3-aab1-b671f129ebef None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:10.855942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdd918-6b70-4ac3-aab1-b671f129ebef None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:10.856217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdd918-6b70-4ac3-aab1-b671f129ebef None admin] PATH_INFO: `/v3/users/e178629438714f7ca1d21caf08bb5a24` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:10.857410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdd918-6b70-4ac3-aab1-b671f129ebef None admin] RBAC: Authorizing `identity:get_user(user_id=e178629438714f7ca1d21caf08bb5a24)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:10.858933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdd918-6b70-4ac3-aab1-b671f129ebef None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:10.860955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 70/125] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:10 2022] GET /identity/v3/users/e178629438714f7ca1d21caf08bb5a24 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:10.861605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdd918-6b70-4ac3-aab1-b671f129ebef None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:10.947012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd0f75-2b77-47a0-a305-e844027d0dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:10.947694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0f75-2b77-47a0-a305-e844027d0dff None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:10.947987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0f75-2b77-47a0-a305-e844027d0dff None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:10.948272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd0f75-2b77-47a0-a305-e844027d0dff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:10.973184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdd918-6b70-4ac3-aab1-b671f129ebef None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:10.991096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd0f75-2b77-47a0-a305-e844027d0dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d0dd0f75-2b77-47a0-a305-e844027d0dff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:10.996187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:10.997060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:10.997844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 56/126] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:11.007162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd0f75-2b77-47a0-a305-e844027d0dff None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:11.011092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd532f9-8096-4174-8d7a-1454311c7a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:11.011749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd532f9-8096-4174-8d7a-1454311c7a02 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:11.012053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd532f9-8096-4174-8d7a-1454311c7a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:11.012630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd532f9-8096-4174-8d7a-1454311c7a02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:11.024526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd532f9-8096-4174-8d7a-1454311c7a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-2bd532f9-8096-4174-8d7a-1454311c7a02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:11.030348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:11.031224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 71/127] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:11.032735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd532f9-8096-4174-8d7a-1454311c7a02 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:11.038018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:11.145324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd532f9-8096-4174-8d7a-1454311c7a02 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:11.185526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:11.186314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:11.186607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:11.186892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:11.187705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:11.188025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:11.189509 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:11.199182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 72/128] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:11.200111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:11.295045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd0f75-2b77-47a0-a305-e844027d0dff None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:11.314035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:11.342447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e28d-4f55-49d7-9739-713910731b4e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:11.388913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:11.389637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:11.390040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:11.390323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:11.391021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:11.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:11.392738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:11.402503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 73/129] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:11.403663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:11.404815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b911701-c029-49a0-ad8d-3487dea275d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:11.405479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b911701-c029-49a0-ad8d-3487dea275d5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:11.405789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b911701-c029-49a0-ad8d-3487dea275d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:11.406067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b911701-c029-49a0-ad8d-3487dea275d5 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:11.411543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b911701-c029-49a0-ad8d-3487dea275d5 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:11.413071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b911701-c029-49a0-ad8d-3487dea275d5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:11.425934 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 57/130] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:10 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:11.429473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b911701-c029-49a0-ad8d-3487dea275d5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:11.519994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:11.557181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9737c81-eaf5-4788-8214-bb0e0f754a98 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:11.590241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:11.600056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272df6e-dd7a-4774-8c88-ecf481ee8086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:11.600723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272df6e-dd7a-4774-8c88-ecf481ee8086 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:11.601009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272df6e-dd7a-4774-8c88-ecf481ee8086 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:11.601290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272df6e-dd7a-4774-8c88-ecf481ee8086 None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:11.602598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272df6e-dd7a-4774-8c88-ecf481ee8086 None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:11.604733 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272df6e-dd7a-4774-8c88-ecf481ee8086 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:11.606674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 74/131] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:11 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:11.607516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272df6e-dd7a-4774-8c88-ecf481ee8086 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:11.727732 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b911701-c029-49a0-ad8d-3487dea275d5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:11.733418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272df6e-dd7a-4774-8c88-ecf481ee8086 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:11.804092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c9e77-b374-4686-93f6-71e794aade1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:11.804774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c9e77-b374-4686-93f6-71e794aade1b None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:11.805056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c9e77-b374-4686-93f6-71e794aade1b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:11.805332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c9e77-b374-4686-93f6-71e794aade1b None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/users/e178629438714f7ca1d21caf08bb5a24/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:11.807752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c9e77-b374-4686-93f6-71e794aade1b None admin] RBAC: Authorizing `identity:create_grant(project_id=f289526ed98a4fe38c3ad61be0ecd099, user_id=e178629438714f7ca1d21caf08bb5a24, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:11.809492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c9e77-b374-4686-93f6-71e794aade1b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:11.829938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 75/132] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:11 2022] PUT /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/users/e178629438714f7ca1d21caf08bb5a24/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:11.831615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c9e77-b374-4686-93f6-71e794aade1b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:11.832081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758d1a6-f368-4f30-b286-4ec71c87765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:11.834403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758d1a6-f368-4f30-b286-4ec71c87765d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:11.834930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758d1a6-f368-4f30-b286-4ec71c87765d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:11.835213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758d1a6-f368-4f30-b286-4ec71c87765d None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:11.838573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758d1a6-f368-4f30-b286-4ec71c87765d None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:11.840260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758d1a6-f368-4f30-b286-4ec71c87765d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:11.843162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 58/133] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:11 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:11.851489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758d1a6-f368-4f30-b286-4ec71c87765d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:11.975922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:12.092631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c9e77-b374-4686-93f6-71e794aade1b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:12.102369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758d1a6-f368-4f30-b286-4ec71c87765d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:12.110342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:12.149874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d30d6-1e01-4a18-87e0-bf300fb90476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:12.150600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d30d6-1e01-4a18-87e0-bf300fb90476 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:12.150907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d30d6-1e01-4a18-87e0-bf300fb90476 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:12.151191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d30d6-1e01-4a18-87e0-bf300fb90476 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:12.152515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d30d6-1e01-4a18-87e0-bf300fb90476 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:12.154352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d30d6-1e01-4a18-87e0-bf300fb90476 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:12.156740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 76/134] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:11 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:12.158245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781baec2-5af0-4fdd-a8c5-d7332d5782c6 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:12.158532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781baec2-5af0-4fdd-a8c5-d7332d5782c6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:12.158815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781baec2-5af0-4fdd-a8c5-d7332d5782c6 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:12.161190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 77/135] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:12.169891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781baec2-5af0-4fdd-a8c5-d7332d5782c6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:12.175247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ecf65-ae36-4c89-8dcd-e40e2afb3d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:12.175911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ecf65-ae36-4c89-8dcd-e40e2afb3d03 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:12.176201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ecf65-ae36-4c89-8dcd-e40e2afb3d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:12.176552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ecf65-ae36-4c89-8dcd-e40e2afb3d03 None admin] PATH_INFO: `/v3/projects/00c4cf900fe14c53bac59d9fccfbb721` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:12.177814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ecf65-ae36-4c89-8dcd-e40e2afb3d03 None admin] RBAC: Authorizing `identity:get_project(project_id=00c4cf900fe14c53bac59d9fccfbb721)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:12.179305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ecf65-ae36-4c89-8dcd-e40e2afb3d03 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:12.181271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 59/136] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:11 2022] GET /identity/v3/projects/00c4cf900fe14c53bac59d9fccfbb721 => generated 312 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:12.182807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046b95-93f3-4ed3-81fa-17498c79a490 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:12.183105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046b95-93f3-4ed3-81fa-17498c79a490 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:12.183394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a046b95-93f3-4ed3-81fa-17498c79a490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:12.208423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0a046b95-93f3-4ed3-81fa-17498c79a490 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:12.209814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0a046b95-93f3-4ed3-81fa-17498c79a490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:12.342980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781baec2-5af0-4fdd-a8c5-d7332d5782c6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:12.371669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:12.402682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc9cb-cff1-47a3-b650-ec54af72df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:12.403610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc9cb-cff1-47a3-b650-ec54af72df0a None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:12.403893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc9cb-cff1-47a3-b650-ec54af72df0a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:12.404169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc9cb-cff1-47a3-b650-ec54af72df0a None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/users/d75ad6ea00ed490582ccc4fdb2bdd495/roles/0adab6046ed34edf8914c4971198655f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:12.405546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 60/137] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:12.406498 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a046b95-93f3-4ed3-81fa-17498c79a490 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:12.410929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fc9cb-cff1-47a3-b650-ec54af72df0a None admin] RBAC: Authorizing `identity:create_grant(project_id=f289526ed98a4fe38c3ad61be0ecd099, user_id=d75ad6ea00ed490582ccc4fdb2bdd495, role_id=0adab6046ed34edf8914c4971198655f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:12.428734 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fc9cb-cff1-47a3-b650-ec54af72df0a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:12.455500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 78/138] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:12 2022] PUT /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/users/d75ad6ea00ed490582ccc4fdb2bdd495/roles/0adab6046ed34edf8914c4971198655f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:12.567972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:12.571870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a046b95-93f3-4ed3-81fa-17498c79a490 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:12.617881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc90f-16cc-4a4f-8eab-78d2077225d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:12.618705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc90f-16cc-4a4f-8eab-78d2077225d0 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:12.619078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc90f-16cc-4a4f-8eab-78d2077225d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:12.619318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc90f-16cc-4a4f-8eab-78d2077225d0 None admin] PATH_INFO: `/v3/projects/00c4cf900fe14c53bac59d9fccfbb721/users/d75ad6ea00ed490582ccc4fdb2bdd495/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:12.623984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc90f-16cc-4a4f-8eab-78d2077225d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=00c4cf900fe14c53bac59d9fccfbb721, user_id=d75ad6ea00ed490582ccc4fdb2bdd495, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:12.625513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc90f-16cc-4a4f-8eab-78d2077225d0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:12.651236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 61/139] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:12 2022] PUT /identity/v3/projects/00c4cf900fe14c53bac59d9fccfbb721/users/d75ad6ea00ed490582ccc4fdb2bdd495/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:12.808454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc9cb-cff1-47a3-b650-ec54af72df0a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:12.929787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc9cb-cff1-47a3-b650-ec54af72df0a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:12.973213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d846-6ace-46c2-a17e-f86334a3d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:12.973934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d846-6ace-46c2-a17e-f86334a3d59b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:12.974220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d846-6ace-46c2-a17e-f86334a3d59b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:12.974496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d846-6ace-46c2-a17e-f86334a3d59b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:12.977280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8d846-6ace-46c2-a17e-f86334a3d59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:12.978830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8d846-6ace-46c2-a17e-f86334a3d59b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:12.980456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 79/140] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:12.986174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc90f-16cc-4a4f-8eab-78d2077225d0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:13.036561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45454af-17aa-4f43-92a4-db3b9776de7e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:13.036849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45454af-17aa-4f43-92a4-db3b9776de7e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:13.037126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45454af-17aa-4f43-92a4-db3b9776de7e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:13.038659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 80/141] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:13.045103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65033944-a61b-4277-ac04-083a99994d2f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:13.045393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65033944-a61b-4277-ac04-083a99994d2f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:13.045709 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65033944-a61b-4277-ac04-083a99994d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:13.073622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-65033944-a61b-4277-ac04-083a99994d2f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:13.073622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-65033944-a61b-4277-ac04-083a99994d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:13.147844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:13.173262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc90f-16cc-4a4f-8eab-78d2077225d0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:13.185009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 81/142] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:13.238327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab40f9-beb4-4e73-8848-2e22f8b89f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:13.238960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab40f9-beb4-4e73-8848-2e22f8b89f18 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:13.239781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab40f9-beb4-4e73-8848-2e22f8b89f18 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:13.240060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab40f9-beb4-4e73-8848-2e22f8b89f18 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:13.240758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab40f9-beb4-4e73-8848-2e22f8b89f18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:13.242262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab40f9-beb4-4e73-8848-2e22f8b89f18 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:13.273544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 62/143] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:34:12 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:34:13.638823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02245-d84c-47f1-a9bb-9a87aa0adb55 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:13.639508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02245-d84c-47f1-a9bb-9a87aa0adb55 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:13.639991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da02245-d84c-47f1-a9bb-9a87aa0adb55 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:13.641571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 82/144] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:13.647144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9e43-593c-4012-868d-630bfbaa9d15 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:13.647438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9e43-593c-4012-868d-630bfbaa9d15 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:13.647716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f9e43-593c-4012-868d-630bfbaa9d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:13.674066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2e3f9e43-593c-4012-868d-630bfbaa9d15 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:13.675274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2e3f9e43-593c-4012-868d-630bfbaa9d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:13.693361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:13.771501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 63/145] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:13.775897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da02245-d84c-47f1-a9bb-9a87aa0adb55 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:13.920244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da02245-d84c-47f1-a9bb-9a87aa0adb55 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:13.984243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46027a1-889c-4154-90b9-872cc12cf44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:13.985237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46027a1-889c-4154-90b9-872cc12cf44b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:13.985770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46027a1-889c-4154-90b9-872cc12cf44b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:13.986242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46027a1-889c-4154-90b9-872cc12cf44b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:13.999777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46027a1-889c-4154-90b9-872cc12cf44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d46027a1-889c-4154-90b9-872cc12cf44b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:14.005100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:14.006062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:14.006801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:14.009108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 83/146] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:14.015268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f9e43-593c-4012-868d-630bfbaa9d15 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:14.108881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46027a1-889c-4154-90b9-872cc12cf44b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:14.167479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f9e43-593c-4012-868d-630bfbaa9d15 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:14.202107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:14.246442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:14.247093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:14.247380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:14.247660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:14.248362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:14.248683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:14.250408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:14.273319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 64/147] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:14.278987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:14.304567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:14.318197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46027a1-889c-4154-90b9-872cc12cf44b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:14.361566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aeb48-e256-4eb7-9e9a-9278e4e17763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:14.362260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aeb48-e256-4eb7-9e9a-9278e4e17763 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:14.362538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aeb48-e256-4eb7-9e9a-9278e4e17763 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:14.362808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aeb48-e256-4eb7-9e9a-9278e4e17763 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:14.380476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aeb48-e256-4eb7-9e9a-9278e4e17763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8b6aeb48-e256-4eb7-9e9a-9278e4e17763 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:14.391333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:14.392205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:14.392942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 84/148] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:14.400653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aeb48-e256-4eb7-9e9a-9278e4e17763 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:14.463744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66f28-ac6f-4c9c-8a89-39ed4cf0974c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:14.504505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0b4f-70b5-4d36-9a43-401685711b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:14.505377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0b4f-70b5-4d36-9a43-401685711b5c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:14.505701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0b4f-70b5-4d36-9a43-401685711b5c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:14.505987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f0b4f-70b5-4d36-9a43-401685711b5c None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:14.508273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f0b4f-70b5-4d36-9a43-401685711b5c None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:14.509809 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f0b4f-70b5-4d36-9a43-401685711b5c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:14.512406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 65/149] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:14 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:14.518967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0b4f-70b5-4d36-9a43-401685711b5c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:14.620672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:14.647616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f0b4f-70b5-4d36-9a43-401685711b5c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:14.687018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b856d-64ad-45ca-a995-3caf175073ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:14.687704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b856d-64ad-45ca-a995-3caf175073ac None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:14.687996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b856d-64ad-45ca-a995-3caf175073ac None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:14.688280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b856d-64ad-45ca-a995-3caf175073ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:14.727692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aeb48-e256-4eb7-9e9a-9278e4e17763 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:14.730935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:14.768136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b856d-64ad-45ca-a995-3caf175073ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:14.769673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b856d-64ad-45ca-a995-3caf175073ac None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:14.857982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:14.862946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:14.863588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:14.863868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:14.864191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:14.864875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:14.865180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:14.866667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:14.893286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 66/150] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 12:34:14.899854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b856d-64ad-45ca-a995-3caf175073ac None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:14.900196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 85/151] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:14.905732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:15.041980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b856d-64ad-45ca-a995-3caf175073ac None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:15.076027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426d829-e57e-48fb-be3e-2e1063ee14cf None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:15.093450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7212c3-bc7f-4229-b618-0312b11d19f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:15.094146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7212c3-bc7f-4229-b618-0312b11d19f8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:15.094495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7212c3-bc7f-4229-b618-0312b11d19f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:15.094780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7212c3-bc7f-4229-b618-0312b11d19f8 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:15.096059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7212c3-bc7f-4229-b618-0312b11d19f8 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:15.098190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7212c3-bc7f-4229-b618-0312b11d19f8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:15.099928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 67/152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:14 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:15.105898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7212c3-bc7f-4229-b618-0312b11d19f8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:15.132123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94ad53-d89f-4c6d-a0cd-f08d2758aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:15.132782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94ad53-d89f-4c6d-a0cd-f08d2758aca3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:15.133063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94ad53-d89f-4c6d-a0cd-f08d2758aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:15.133336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94ad53-d89f-4c6d-a0cd-f08d2758aca3 None admin] PATH_INFO: `/v3/users/2c7a453044c94b0faa1c8e94bfeb0c10` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:15.134552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94ad53-d89f-4c6d-a0cd-f08d2758aca3 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7a453044c94b0faa1c8e94bfeb0c10)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:15.136017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94ad53-d89f-4c6d-a0cd-f08d2758aca3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:15.137976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 86/153] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:14 2022] GET /identity/v3/users/2c7a453044c94b0faa1c8e94bfeb0c10 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:15.143421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94ad53-d89f-4c6d-a0cd-f08d2758aca3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:15.177427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:15.200248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:15.258102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7212c3-bc7f-4229-b618-0312b11d19f8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:15.297675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94ad53-d89f-4c6d-a0cd-f08d2758aca3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:15.312977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:15.313632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:15.314612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:15.314897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:15.315667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] RBAC: Adding query filter params (role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099, user.id=d75ad6ea00ed490582ccc4fdb2bdd495) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:15.315990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:15.320207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:15.326875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 68/154] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:15 2022] GET /identity/v3/role_assignments?user.id=d75ad6ea00ed490582ccc4fdb2bdd495&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:15.392487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0717d5-dd1a-4c73-aaae-3f37581a4bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:15.393159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0717d5-dd1a-4c73-aaae-3f37581a4bfc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:15.393439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0717d5-dd1a-4c73-aaae-3f37581a4bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:15.393743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0717d5-dd1a-4c73-aaae-3f37581a4bfc None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:15.398573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0717d5-dd1a-4c73-aaae-3f37581a4bfc None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:15.400106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0717d5-dd1a-4c73-aaae-3f37581a4bfc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:15.402269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 87/155] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:15 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:15.408613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:15.503216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5ba2-11db-47ba-8eb8-7eb8941779ed None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:15.503572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5ba2-11db-47ba-8eb8-7eb8941779ed None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:15.503772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5ba2-11db-47ba-8eb8-7eb8941779ed None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:15.505832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 88/156] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:15.515225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dc9a0-a669-4f03-9931-6421d0e35fc6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:15.515546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dc9a0-a669-4f03-9931-6421d0e35fc6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:15.515824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dc9a0-a669-4f03-9931-6421d0e35fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:15.562864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d34dc9a0-a669-4f03-9931-6421d0e35fc6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:15.564022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d34dc9a0-a669-4f03-9931-6421d0e35fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:15.580844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7813b-5c1b-4ed5-9aa5-958dde01251e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:15.592397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:15.637097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2fb29-2eba-45d5-8132-a70b1141228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:15.637900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fb29-2eba-45d5-8132-a70b1141228e None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:15.638238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fb29-2eba-45d5-8132-a70b1141228e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:15.638522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2fb29-2eba-45d5-8132-a70b1141228e None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/users/2c7a453044c94b0faa1c8e94bfeb0c10/roles/1bf206c740ba4f59b66a1cc010f7aee9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:15.640634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2fb29-2eba-45d5-8132-a70b1141228e None admin] RBAC: Authorizing `identity:create_grant(project_id=f289526ed98a4fe38c3ad61be0ecd099, user_id=2c7a453044c94b0faa1c8e94bfeb0c10, role_id=1bf206c740ba4f59b66a1cc010f7aee9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:15.642259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2fb29-2eba-45d5-8132-a70b1141228e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:15.671684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 69/157] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:15 2022] PUT /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/users/2c7a453044c94b0faa1c8e94bfeb0c10/roles/1bf206c740ba4f59b66a1cc010f7aee9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:15.739708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 89/158] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:16.188691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81870-74fd-4a5e-b5cc-aa328035746e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:16.189306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81870-74fd-4a5e-b5cc-aa328035746e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:16.189306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81870-74fd-4a5e-b5cc-aa328035746e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:16.190640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 70/159] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:16.196263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bab0a-9265-48ed-85f8-1aeb3fa02701 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:16.196753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bab0a-9265-48ed-85f8-1aeb3fa02701 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:16.196836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bab0a-9265-48ed-85f8-1aeb3fa02701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:16.224475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-460bab0a-9265-48ed-85f8-1aeb3fa02701 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:16.225731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-460bab0a-9265-48ed-85f8-1aeb3fa02701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:16.263560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9885-ed35-4dd6-86a5-48f5af66926b None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:16.263883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9885-ed35-4dd6-86a5-48f5af66926b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:16.264130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c9885-ed35-4dd6-86a5-48f5af66926b None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:16.265803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 71/160] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:16.266076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:16.274682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3acb2-c278-41b3-9fae-84fbf8d778ce None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:16.274997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3acb2-c278-41b3-9fae-84fbf8d778ce None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:16.275239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3acb2-c278-41b3-9fae-84fbf8d778ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:16.306277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-eae3acb2-c278-41b3-9fae-84fbf8d778ce None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:16.307489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-eae3acb2-c278-41b3-9fae-84fbf8d778ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:16.354089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 90/161] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:16.405814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bab0a-9265-48ed-85f8-1aeb3fa02701 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:16.426960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 72/162] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:16.573442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bab0a-9265-48ed-85f8-1aeb3fa02701 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:16.653636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c165-2b37-4c25-87b0-6b1ae7bc0601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:16.654766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c165-2b37-4c25-87b0-6b1ae7bc0601 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:16.655250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c165-2b37-4c25-87b0-6b1ae7bc0601 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:16.655948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79c165-2b37-4c25-87b0-6b1ae7bc0601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:16.687079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79c165-2b37-4c25-87b0-6b1ae7bc0601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fd79c165-2b37-4c25-87b0-6b1ae7bc0601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:16.697389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:16.698312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:16.699093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:16.699766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 91/163] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:34:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:34:16.705898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3acb2-c278-41b3-9fae-84fbf8d778ce None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:16.829835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c165-2b37-4c25-87b0-6b1ae7bc0601 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:16.849569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:16.855609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3acb2-c278-41b3-9fae-84fbf8d778ce None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:16.900691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:16.918427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:16.919056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:16.919338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:16.919614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:16.920304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:16.920603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:16.922198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:16.937494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 73/164] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:16.943599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:17.154160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12e58-eca1-4103-a103-a9d388cb8793 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:17.201440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79c165-2b37-4c25-87b0-6b1ae7bc0601 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:17.220242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3215b77-5d61-45c6-a94a-28949941ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:17.220242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215b77-5d61-45c6-a94a-28949941ee8e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:17.220242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215b77-5d61-45c6-a94a-28949941ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:17.220242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215b77-5d61-45c6-a94a-28949941ee8e None admin] PATH_INFO: `/v3/users/e178629438714f7ca1d21caf08bb5a24` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:17.221813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3215b77-5d61-45c6-a94a-28949941ee8e None admin] RBAC: Authorizing `identity:get_user(user_id=e178629438714f7ca1d21caf08bb5a24)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:17.223896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3215b77-5d61-45c6-a94a-28949941ee8e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:17.225632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 74/165] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:16 2022] GET /identity/v3/users/e178629438714f7ca1d21caf08bb5a24 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:17.231145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3215b77-5d61-45c6-a94a-28949941ee8e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:17.285643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:17.299235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f91b08-fa3c-4875-ace9-26af7cb57a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:17.306226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91b08-fa3c-4875-ace9-26af7cb57a82 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:17.307066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91b08-fa3c-4875-ace9-26af7cb57a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:17.307786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91b08-fa3c-4875-ace9-26af7cb57a82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:17.339291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f91b08-fa3c-4875-ace9-26af7cb57a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d5f91b08-fa3c-4875-ace9-26af7cb57a82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:17.356822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:17.358401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:17.360118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:17.367363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 92/166] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 539 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:17.374313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f91b08-fa3c-4875-ace9-26af7cb57a82 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:17.470120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3215b77-5d61-45c6-a94a-28949941ee8e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:17.547155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc16f70-24e3-41f2-ab58-1edafcb7b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:17.547794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc16f70-24e3-41f2-ab58-1edafcb7b5ab None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:17.548086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc16f70-24e3-41f2-ab58-1edafcb7b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:17.548419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc16f70-24e3-41f2-ab58-1edafcb7b5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:17.654084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:17.724704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc16f70-24e3-41f2-ab58-1edafcb7b5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:17.728886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc16f70-24e3-41f2-ab58-1edafcb7b5ab None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:17.732711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f91b08-fa3c-4875-ace9-26af7cb57a82 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:17.825107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:17.825838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:17.826105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:17.826368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:17.827046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:17.827346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:17.828734 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:17.830132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:17.844579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 93/167] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:17.845463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:18.054859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2d127-d76b-4c0a-bd71-f2331d46a14c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:18.088509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 75/168] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 12:34:18.091255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc16f70-24e3-41f2-ab58-1edafcb7b5ab None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:18.136828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef28cb-4f1c-43ec-b4e0-4226733241a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:18.137486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef28cb-4f1c-43ec-b4e0-4226733241a4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:18.137803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef28cb-4f1c-43ec-b4e0-4226733241a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:18.138076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef28cb-4f1c-43ec-b4e0-4226733241a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:18.162560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef28cb-4f1c-43ec-b4e0-4226733241a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3fef28cb-4f1c-43ec-b4e0-4226733241a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:18.168661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:18.170442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 94/169] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:18.172656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef28cb-4f1c-43ec-b4e0-4226733241a4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:18.180938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:18.356953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef28cb-4f1c-43ec-b4e0-4226733241a4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:18.486223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc16f70-24e3-41f2-ab58-1edafcb7b5ab None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:18.502783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647da3f-91b4-4418-a9eb-9a846b058998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:18.504351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647da3f-91b4-4418-a9eb-9a846b058998 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:18.505757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647da3f-91b4-4418-a9eb-9a846b058998 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:18.506571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647da3f-91b4-4418-a9eb-9a846b058998 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:18.514991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647da3f-91b4-4418-a9eb-9a846b058998 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:18.518356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647da3f-91b4-4418-a9eb-9a846b058998 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:18.522016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 95/170] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:18 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:18.523885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647da3f-91b4-4418-a9eb-9a846b058998 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:18.569694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:18.591769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bfcfd-d83f-485a-9809-801c493b19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:18.592428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bfcfd-d83f-485a-9809-801c493b19f3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:18.592709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bfcfd-d83f-485a-9809-801c493b19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:18.593003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bfcfd-d83f-485a-9809-801c493b19f3 None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:18.598611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bfcfd-d83f-485a-9809-801c493b19f3 None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:18.600143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bfcfd-d83f-485a-9809-801c493b19f3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:18.602293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 76/171] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:18 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:18.603635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe522a3-8019-4d63-919c-4106f2bbf209 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:18.603925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe522a3-8019-4d63-919c-4106f2bbf209 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:18.604197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe522a3-8019-4d63-919c-4106f2bbf209 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:18.605519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 77/172] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:18.612895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe522a3-8019-4d63-919c-4106f2bbf209 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:18.696881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:18.760302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647da3f-91b4-4418-a9eb-9a846b058998 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:18.831391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040c67f-2530-44df-8993-a7531778068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:18.832016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040c67f-2530-44df-8993-a7531778068c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:18.832292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040c67f-2530-44df-8993-a7531778068c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:18.832563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040c67f-2530-44df-8993-a7531778068c None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:18.833297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040c67f-2530-44df-8993-a7531778068c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:18.833621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040c67f-2530-44df-8993-a7531778068c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:18.835050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040c67f-2530-44df-8993-a7531778068c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:18.853764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 96/173] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:18.854834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040c67f-2530-44df-8993-a7531778068c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:18.879994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe522a3-8019-4d63-919c-4106f2bbf209 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:18.970166 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f50540-85f2-4f26-8165-7a61a37c8b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:18.972723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50540-85f2-4f26-8165-7a61a37c8b5e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:18.974413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50540-85f2-4f26-8165-7a61a37c8b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:18.975495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50540-85f2-4f26-8165-7a61a37c8b5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:18.977776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f50540-85f2-4f26-8165-7a61a37c8b5e None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099, user.id=e178629438714f7ca1d21caf08bb5a24) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:18.978620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f50540-85f2-4f26-8165-7a61a37c8b5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:18.983170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f50540-85f2-4f26-8165-7a61a37c8b5e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:18.994879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040c67f-2530-44df-8993-a7531778068c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:19.001031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 78/174] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:18 2022] GET /identity/v3/role_assignments?user.id=e178629438714f7ca1d21caf08bb5a24&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=b8bf66974c0448089a192ead432a35f2 => generated 608 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:19.004547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbf76f-4284-4edb-90ab-051e66a691ab None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.005456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbf76f-4284-4edb-90ab-051e66a691ab None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.006332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbf76f-4284-4edb-90ab-051e66a691ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.028974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-76dbf76f-4284-4edb-90ab-051e66a691ab None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:19.030033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-76dbf76f-4284-4edb-90ab-051e66a691ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:19.048943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:19.058738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274a191-4b3f-4815-ab49-2cd2bd7a531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:19.060432 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a191-4b3f-4815-ab49-2cd2bd7a531d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.061381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a191-4b3f-4815-ab49-2cd2bd7a531d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.062033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a191-4b3f-4815-ab49-2cd2bd7a531d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.101300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:19.135273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 79/175] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:19.137626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7beb-defb-4e88-8e6c-ee4b2f29745d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.138167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7beb-defb-4e88-8e6c-ee4b2f29745d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.138648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b7beb-defb-4e88-8e6c-ee4b2f29745d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.141250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 80/176] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:19.147007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b7beb-defb-4e88-8e6c-ee4b2f29745d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:19.203953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274a191-4b3f-4815-ab49-2cd2bd7a531d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:19.206771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274a191-4b3f-4815-ab49-2cd2bd7a531d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:19.458433 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b7beb-defb-4e88-8e6c-ee4b2f29745d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:19.492660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 97/177] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:19.496025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8bc85-a6d5-4a9e-ad3f-823ef8589206 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.496971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8bc85-a6d5-4a9e-ad3f-823ef8589206 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.497465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8bc85-a6d5-4a9e-ad3f-823ef8589206 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.501773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 98/178] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:19.503982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470178a-237e-4ccb-858f-e3fac44f5083 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.504474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470178a-237e-4ccb-858f-e3fac44f5083 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.505498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470178a-237e-4ccb-858f-e3fac44f5083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.511859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742efa-7b76-4ca8-9791-68a0184ddff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:19.512644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742efa-7b76-4ca8-9791-68a0184ddff6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.512762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742efa-7b76-4ca8-9791-68a0184ddff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.513190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1742efa-7b76-4ca8-9791-68a0184ddff6 None admin] PATH_INFO: `/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.514268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742efa-7b76-4ca8-9791-68a0184ddff6 None admin] RBAC: Authorizing `identity:get_user(user_id=d75ad6ea00ed490582ccc4fdb2bdd495)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:19.515834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1742efa-7b76-4ca8-9791-68a0184ddff6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:19.517442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 81/179] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:19 2022] GET /identity/v3/users/d75ad6ea00ed490582ccc4fdb2bdd495 => generated 275 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:19.518546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742efa-7b76-4ca8-9791-68a0184ddff6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:19.545916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9470178a-237e-4ccb-858f-e3fac44f5083 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:19.548013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9470178a-237e-4ccb-858f-e3fac44f5083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:19.602712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:19.607463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:19.667549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1742efa-7b76-4ca8-9791-68a0184ddff6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:19.685779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 99/180] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:19.685779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470178a-237e-4ccb-858f-e3fac44f5083 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:19.730040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4249fe9-50d4-4b94-a7fd-1cf8befd7a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:19.731217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4249fe9-50d4-4b94-a7fd-1cf8befd7a93 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.731721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4249fe9-50d4-4b94-a7fd-1cf8befd7a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.732325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4249fe9-50d4-4b94-a7fd-1cf8befd7a93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.751299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4249fe9-50d4-4b94-a7fd-1cf8befd7a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b4249fe9-50d4-4b94-a7fd-1cf8befd7a93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:19.762834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:19.764585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:19.766199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 82/181] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:19.767479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c1a8-7c12-47ba-85bd-ea1ad92205c3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.767604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c1a8-7c12-47ba-85bd-ea1ad92205c3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.773655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c1a8-7c12-47ba-85bd-ea1ad92205c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.798154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0723c1a8-7c12-47ba-85bd-ea1ad92205c3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:19.800564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0723c1a8-7c12-47ba-85bd-ea1ad92205c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:19.877744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470178a-237e-4ccb-858f-e3fac44f5083 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:19.895057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 83/182] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:19.896697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c1a8-7c12-47ba-85bd-ea1ad92205c3 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:19.939252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b03d7-1336-48b5-8fe7-cf456da681c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:19.939887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b03d7-1336-48b5-8fe7-cf456da681c9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:19.940241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b03d7-1336-48b5-8fe7-cf456da681c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:19.940528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b03d7-1336-48b5-8fe7-cf456da681c9 None admin] PATH_INFO: `/v3/projects/00c4cf900fe14c53bac59d9fccfbb721` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:19.941889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b03d7-1336-48b5-8fe7-cf456da681c9 None admin] RBAC: Authorizing `identity:get_project(project_id=00c4cf900fe14c53bac59d9fccfbb721)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:19.944379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b03d7-1336-48b5-8fe7-cf456da681c9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:19.947237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 100/183] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:19 2022] GET /identity/v3/projects/00c4cf900fe14c53bac59d9fccfbb721 => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:19.948307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b03d7-1336-48b5-8fe7-cf456da681c9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:19.971585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:19.997296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:20.063269 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c1a8-7c12-47ba-85bd-ea1ad92205c3 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:20.098574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b03d7-1336-48b5-8fe7-cf456da681c9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:20.126220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9d8a-14d1-4f0f-962f-e6f1d6fbff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:20.127679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9d8a-14d1-4f0f-962f-e6f1d6fbff80 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.128392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9d8a-14d1-4f0f-962f-e6f1d6fbff80 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.128964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce9d8a-14d1-4f0f-962f-e6f1d6fbff80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.187732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939e9e2-44f9-4cdf-be96-04668e0aec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:20.189348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939e9e2-44f9-4cdf-be96-04668e0aec93 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.189913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939e9e2-44f9-4cdf-be96-04668e0aec93 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.190485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939e9e2-44f9-4cdf-be96-04668e0aec93 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.192788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939e9e2-44f9-4cdf-be96-04668e0aec93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:20.194014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939e9e2-44f9-4cdf-be96-04668e0aec93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:20.197323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939e9e2-44f9-4cdf-be96-04668e0aec93 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:20.219026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 101/184] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:20.221326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795dac-88d5-4a1a-9f45-d3f47ff9d825 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.221876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795dac-88d5-4a1a-9f45-d3f47ff9d825 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.222387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795dac-88d5-4a1a-9f45-d3f47ff9d825 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.222484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9d8a-14d1-4f0f-962f-e6f1d6fbff80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:20.228885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 102/185] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:20.229052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce9d8a-14d1-4f0f-962f-e6f1d6fbff80 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:20.229153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8795dac-88d5-4a1a-9f45-d3f47ff9d825 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:20.280320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:20.350482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:20.356708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 84/186] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:20.358582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9d8a-14d1-4f0f-962f-e6f1d6fbff80 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:20.367814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8795dac-88d5-4a1a-9f45-d3f47ff9d825 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:20.416903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:20.418737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.418737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.418896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.419510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] RBAC: Adding query filter params (role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=00c4cf900fe14c53bac59d9fccfbb721, user.id=d75ad6ea00ed490582ccc4fdb2bdd495) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:20.419823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:20.421963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:20.429070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 103/187] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:20 2022] GET /identity/v3/role_assignments?user.id=d75ad6ea00ed490582ccc4fdb2bdd495&scope.project.id=00c4cf900fe14c53bac59d9fccfbb721&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:20.429961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:20.502676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce9d8a-14d1-4f0f-962f-e6f1d6fbff80 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:20.550297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed23d-8876-4bba-bb09-c99a25262236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:20.551314 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed23d-8876-4bba-bb09-c99a25262236 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.552206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed23d-8876-4bba-bb09-c99a25262236 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.552463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed23d-8876-4bba-bb09-c99a25262236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.554105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ed23d-8876-4bba-bb09-c99a25262236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:20.556377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ed23d-8876-4bba-bb09-c99a25262236 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:20.558240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 85/188] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:20.558969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed23d-8876-4bba-bb09-c99a25262236 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:20.581550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c8fe-e0ac-458a-97df-9493d1816088 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:20.587219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:20.623292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae782d07-8c82-4421-9df7-92405cd01a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:20.624043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae782d07-8c82-4421-9df7-92405cd01a5f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.624325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae782d07-8c82-4421-9df7-92405cd01a5f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.624599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae782d07-8c82-4421-9df7-92405cd01a5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.637830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae782d07-8c82-4421-9df7-92405cd01a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-ae782d07-8c82-4421-9df7-92405cd01a5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:20.643385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:20.644451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 104/189] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:20.647034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb680-cfcb-4367-9d57-0a34d1f7c3b7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.648850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb680-cfcb-4367-9d57-0a34d1f7c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.648850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb680-cfcb-4367-9d57-0a34d1f7c3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.673681 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-875eb680-cfcb-4367-9d57-0a34d1f7c3b7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:20.674884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-875eb680-cfcb-4367-9d57-0a34d1f7c3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:20.688177 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:20.701151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed23d-8876-4bba-bb09-c99a25262236 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:20.746596 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed4052-4ed0-4bbe-8e4b-70f15932a443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:20.747237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed4052-4ed0-4bbe-8e4b-70f15932a443 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.747520 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed4052-4ed0-4bbe-8e4b-70f15932a443 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.747789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed4052-4ed0-4bbe-8e4b-70f15932a443 None admin] PATH_INFO: `/v3/users/bef6d6838ddd417ab9e892938b66e808` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.765638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed4052-4ed0-4bbe-8e4b-70f15932a443 None admin] RBAC: Authorizing `identity:get_user(user_id=bef6d6838ddd417ab9e892938b66e808)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:20.767092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed4052-4ed0-4bbe-8e4b-70f15932a443 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:20.768804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 86/190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:20 2022] GET /identity/v3/users/bef6d6838ddd417ab9e892938b66e808 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:20.770030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 105/191] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:20.771170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed4052-4ed0-4bbe-8e4b-70f15932a443 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:20.778800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb680-cfcb-4367-9d57-0a34d1f7c3b7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:20.876512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:20.906511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed4052-4ed0-4bbe-8e4b-70f15932a443 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:20.936938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb680-cfcb-4367-9d57-0a34d1f7c3b7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:20.947816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74032-2822-42b5-8652-09c17a694819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:20.948486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74032-2822-42b5-8652-09c17a694819 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.948890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74032-2822-42b5-8652-09c17a694819 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.949244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea74032-2822-42b5-8652-09c17a694819 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:20.950626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea74032-2822-42b5-8652-09c17a694819 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:20.952127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea74032-2822-42b5-8652-09c17a694819 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:20.953846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 87/192] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:20 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:20.954632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74032-2822-42b5-8652-09c17a694819 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:20.997834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5a41-bcbe-437d-9c69-798601bca609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:20.998550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5a41-bcbe-437d-9c69-798601bca609 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:20.998977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5a41-bcbe-437d-9c69-798601bca609 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:20.999435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5a41-bcbe-437d-9c69-798601bca609 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:21.000338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5a41-bcbe-437d-9c69-798601bca609 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:21.002475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5a41-bcbe-437d-9c69-798601bca609 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:21.030925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 106/193] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:34:20 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:34:21.031948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5a41-bcbe-437d-9c69-798601bca609 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:21.034736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:21.094311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea74032-2822-42b5-8652-09c17a694819 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:21.141533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:21.142702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:21.143118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:21.143691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:21.144869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:21.146094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:21.148668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:21.167241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 88/194] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:21.167241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:21.173534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:21.184590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5a41-bcbe-437d-9c69-798601bca609 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:21.233473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045984ad-27c5-4343-a378-c9139f00bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:21.234146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045984ad-27c5-4343-a378-c9139f00bbef None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:21.234428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045984ad-27c5-4343-a378-c9139f00bbef None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:21.234694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045984ad-27c5-4343-a378-c9139f00bbef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:21.338812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045984ad-27c5-4343-a378-c9139f00bbef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:21.340900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045984ad-27c5-4343-a378-c9139f00bbef None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:21.344221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:21.363780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b73810-ece3-4a89-bec6-f74565f3550a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:21.430335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:21.431233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:21.431714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:21.432215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:21.433453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] RBAC: Adding query filter params (role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099, user.id=d75ad6ea00ed490582ccc4fdb2bdd495) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:21.435832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:21.437762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:21.447369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 89/195] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:21 2022] GET /identity/v3/role_assignments?user.id=d75ad6ea00ed490582ccc4fdb2bdd495&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=0adab6046ed34edf8914c4971198655f => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:21.448255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:21.523833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 107/196] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:21.525100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045984ad-27c5-4343-a378-c9139f00bbef None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:21.554306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:21.602195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f5b0a-e275-4475-b08a-6148d651d74b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:21.647703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8908a-fad3-4e51-9f37-1ad3833388ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:21.648419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8908a-fad3-4e51-9f37-1ad3833388ab None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:21.648706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8908a-fad3-4e51-9f37-1ad3833388ab None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:21.648987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8908a-fad3-4e51-9f37-1ad3833388ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:21.662690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8908a-fad3-4e51-9f37-1ad3833388ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8fe8908a-fad3-4e51-9f37-1ad3833388ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:21.668426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:21.669399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 90/197] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:21.670893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8908a-fad3-4e51-9f37-1ad3833388ab None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:21.679324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045984ad-27c5-4343-a378-c9139f00bbef None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:21.682162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:21.729313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fd94-adfb-4466-a910-59572053f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:21.730526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fd94-adfb-4466-a910-59572053f33a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:21.731043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fd94-adfb-4466-a910-59572053f33a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:21.731573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fd94-adfb-4466-a910-59572053f33a None admin] PATH_INFO: `/v3/users/bef6d6838ddd417ab9e892938b66e808` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:21.734033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683fd94-adfb-4466-a910-59572053f33a None admin] RBAC: Authorizing `identity:get_user(user_id=bef6d6838ddd417ab9e892938b66e808)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:21.736274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683fd94-adfb-4466-a910-59572053f33a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:21.738479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 108/198] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:21 2022] GET /identity/v3/users/bef6d6838ddd417ab9e892938b66e808 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:21.744984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fd94-adfb-4466-a910-59572053f33a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:21.858836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8908a-fad3-4e51-9f37-1ad3833388ab None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:21.906031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fd94-adfb-4466-a910-59572053f33a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:21.932800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:21.954422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e479ae5-9847-4540-aab2-9bdd0a75d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:21.955976 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479ae5-9847-4540-aab2-9bdd0a75d3ef None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:21.956476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479ae5-9847-4540-aab2-9bdd0a75d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:21.957358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e479ae5-9847-4540-aab2-9bdd0a75d3ef None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:21.961278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e479ae5-9847-4540-aab2-9bdd0a75d3ef None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:21.964176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e479ae5-9847-4540-aab2-9bdd0a75d3ef None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:21.964603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:21.965251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:21.965634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:21.965936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:21.966692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:21.967010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:21.967830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 91/199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:21 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:21.968441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:21.969395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e479ae5-9847-4540-aab2-9bdd0a75d3ef None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:21.984052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 109/200] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:21.984982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:22.037937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:22.143355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171d87a-554e-4804-a318-9f5b29613c96 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:22.188190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:22.188829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:22.189113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:22.189390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:22.190300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=05e3776e5294421c871d6041b669b876, user.id=bef6d6838ddd417ab9e892938b66e808) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:22.190619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:22.193027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:22.200908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 110/201] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:21 2022] GET /identity/v3/role_assignments?user.id=bef6d6838ddd417ab9e892938b66e808&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=b8bf66974c0448089a192ead432a35f2 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:22.201898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:22.239104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e479ae5-9847-4540-aab2-9bdd0a75d3ef None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:22.338862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7286fe2-a064-4a08-8a83-dd748776a9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:22.339819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7286fe2-a064-4a08-8a83-dd748776a9d6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:22.340107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7286fe2-a064-4a08-8a83-dd748776a9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:22.340426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7286fe2-a064-4a08-8a83-dd748776a9d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:22.400065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:22.411191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b40fca-c616-46ba-922c-476eead86eef None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:22.454500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:22.464380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7286fe2-a064-4a08-8a83-dd748776a9d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:22.466539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7286fe2-a064-4a08-8a83-dd748776a9d6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:22.538084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3589d-b130-425e-9bde-44c0ef3f71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:22.539128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3589d-b130-425e-9bde-44c0ef3f71e3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:22.539641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3589d-b130-425e-9bde-44c0ef3f71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:22.540981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3589d-b130-425e-9bde-44c0ef3f71e3 None admin] PATH_INFO: `/v3/users/2c7a453044c94b0faa1c8e94bfeb0c10` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:22.542580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3589d-b130-425e-9bde-44c0ef3f71e3 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7a453044c94b0faa1c8e94bfeb0c10)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:22.544982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3589d-b130-425e-9bde-44c0ef3f71e3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:22.547157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 111/202] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:22 2022] GET /identity/v3/users/2c7a453044c94b0faa1c8e94bfeb0c10 => generated 289 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:22.553710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3589d-b130-425e-9bde-44c0ef3f71e3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:22.623259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 92/203] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:22.632254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7286fe2-a064-4a08-8a83-dd748776a9d6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:22.784518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3589d-b130-425e-9bde-44c0ef3f71e3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:22.811454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:22.823771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7286fe2-a064-4a08-8a83-dd748776a9d6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:22.905140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f115bb-b44a-4cda-bba5-c70a3c902ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:22.906225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f115bb-b44a-4cda-bba5-c70a3c902ff8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:22.906722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f115bb-b44a-4cda-bba5-c70a3c902ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:22.907207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f115bb-b44a-4cda-bba5-c70a3c902ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:22.960658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6512a-2239-4437-8f6c-124ac4744aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:22.961759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6512a-2239-4437-8f6c-124ac4744aa4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:22.962259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6512a-2239-4437-8f6c-124ac4744aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:22.962753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6512a-2239-4437-8f6c-124ac4744aa4 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:22.971030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6512a-2239-4437-8f6c-124ac4744aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:22.972971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:22.974497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6512a-2239-4437-8f6c-124ac4744aa4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:22.978277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 93/204] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:22 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:22.988481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6512a-2239-4437-8f6c-124ac4744aa4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:23.019080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f115bb-b44a-4cda-bba5-c70a3c902ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:23.021555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f115bb-b44a-4cda-bba5-c70a3c902ff8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:23.132940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 112/205] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 12:34:23.138977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f115bb-b44a-4cda-bba5-c70a3c902ff8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:23.209115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:23.250647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6512a-2239-4437-8f6c-124ac4744aa4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:23.256025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f115bb-b44a-4cda-bba5-c70a3c902ff8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:23.295003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86d98-a061-4216-bf03-79d1a46e55fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:23.296010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86d98-a061-4216-bf03-79d1a46e55fc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:23.296511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86d98-a061-4216-bf03-79d1a46e55fc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:23.297008 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd86d98-a061-4216-bf03-79d1a46e55fc None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:23.298472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd86d98-a061-4216-bf03-79d1a46e55fc None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:23.300272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd86d98-a061-4216-bf03-79d1a46e55fc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:23.302303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 113/206] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:23 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:23.308249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86d98-a061-4216-bf03-79d1a46e55fc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:23.342533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eca57-1f01-43b5-8d7b-7b6711a7f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:23.344780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eca57-1f01-43b5-8d7b-7b6711a7f412 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:23.345297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eca57-1f01-43b5-8d7b-7b6711a7f412 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:23.346105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eca57-1f01-43b5-8d7b-7b6711a7f412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:23.347812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eca57-1f01-43b5-8d7b-7b6711a7f412 None admin] RBAC: Adding query filter params (role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=05e3776e5294421c871d6041b669b876, user.id=bef6d6838ddd417ab9e892938b66e808) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:23.350029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eca57-1f01-43b5-8d7b-7b6711a7f412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:23.351778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eca57-1f01-43b5-8d7b-7b6711a7f412 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:23.364766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 94/207] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:22 2022] GET /identity/v3/role_assignments?user.id=bef6d6838ddd417ab9e892938b66e808&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=0adab6046ed34edf8914c4971198655f => generated 259 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:23.460426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd86d98-a061-4216-bf03-79d1a46e55fc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:23.505350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:23.511689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4cede-8fc5-421f-93b7-b114a3be0862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:23.512320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4cede-8fc5-421f-93b7-b114a3be0862 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:23.512664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4cede-8fc5-421f-93b7-b114a3be0862 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:23.513016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4cede-8fc5-421f-93b7-b114a3be0862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:23.513813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4cede-8fc5-421f-93b7-b114a3be0862 None admin] RBAC: Adding query filter params (role.id=1bf206c740ba4f59b66a1cc010f7aee9, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099, user.id=2c7a453044c94b0faa1c8e94bfeb0c10) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:23.514132 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4cede-8fc5-421f-93b7-b114a3be0862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:23.515658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4cede-8fc5-421f-93b7-b114a3be0862 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:23.526123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 114/208] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:23 2022] GET /identity/v3/role_assignments?user.id=2c7a453044c94b0faa1c8e94bfeb0c10&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=1bf206c740ba4f59b66a1cc010f7aee9 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:23.971068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3d3b-67bd-431e-be54-9a234712ce39 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:23.971590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3d3b-67bd-431e-be54-9a234712ce39 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:23.971665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe3d3b-67bd-431e-be54-9a234712ce39 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:23.973844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 95/209] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:23.980101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c63f2-4380-4223-b68e-c6eac6b38888 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:23.981015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c63f2-4380-4223-b68e-c6eac6b38888 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:23.981497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c63f2-4380-4223-b68e-c6eac6b38888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:24.000279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5651-5b00-431e-ad79-9d5c21828674 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:24.000884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5651-5b00-431e-ad79-9d5c21828674 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:24.001371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5651-5b00-431e-ad79-9d5c21828674 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:24.003015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 96/210] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:34:24.005196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-158c63f2-4380-4223-b68e-c6eac6b38888 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:24.006874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-158c63f2-4380-4223-b68e-c6eac6b38888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:24.012196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c292-fc09-4854-8ca5-5255673414b8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:24.012859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c292-fc09-4854-8ca5-5255673414b8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:24.013329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29c292-fc09-4854-8ca5-5255673414b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:24.034716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3e29c292-fc09-4854-8ca5-5255673414b8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:24.036923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3e29c292-fc09-4854-8ca5-5255673414b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:24.082295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:24.100769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 115/211] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:24.135254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 97/212] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:24.376342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c63f2-4380-4223-b68e-c6eac6b38888 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:24.418488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c292-fc09-4854-8ca5-5255673414b8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:24.492690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c63f2-4380-4223-b68e-c6eac6b38888 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:24.526604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:24.539422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cfca9-6a5c-43b6-8a75-70272900ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:24.540328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cfca9-6a5c-43b6-8a75-70272900ad0f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:24.540845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cfca9-6a5c-43b6-8a75-70272900ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:24.541315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cfca9-6a5c-43b6-8a75-70272900ad0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:24.542935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cfca9-6a5c-43b6-8a75-70272900ad0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:24.545388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cfca9-6a5c-43b6-8a75-70272900ad0f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:24.547491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 116/213] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:24.551012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29c292-fc09-4854-8ca5-5255673414b8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:24.556080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cfca9-6a5c-43b6-8a75-70272900ad0f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:24.595056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e9c81-1a22-4175-a4f3-a8e4f25e7e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:24.596228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e9c81-1a22-4175-a4f3-a8e4f25e7e31 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:24.596710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e9c81-1a22-4175-a4f3-a8e4f25e7e31 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:24.597179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e9c81-1a22-4175-a4f3-a8e4f25e7e31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:24.610060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e9c81-1a22-4175-a4f3-a8e4f25e7e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-700e9c81-1a22-4175-a4f3-a8e4f25e7e31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:24.615659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:24.616515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:24.617287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:24.624563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 98/214] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:24.625866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e9c81-1a22-4175-a4f3-a8e4f25e7e31 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:24.650831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:24.687453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cfca9-6a5c-43b6-8a75-70272900ad0f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:24.744917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e9c81-1a22-4175-a4f3-a8e4f25e7e31 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:24.763208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9be88-ba62-49b1-be25-928ab946a751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:24.764528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9be88-ba62-49b1-be25-928ab946a751 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:24.765217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9be88-ba62-49b1-be25-928ab946a751 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:24.766211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9be88-ba62-49b1-be25-928ab946a751 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:24.768047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9be88-ba62-49b1-be25-928ab946a751 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:24.772487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9be88-ba62-49b1-be25-928ab946a751 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:24.787721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853475-7746-4989-86e8-52350395e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:24.788687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853475-7746-4989-86e8-52350395e84a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:24.789190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853475-7746-4989-86e8-52350395e84a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:24.789694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853475-7746-4989-86e8-52350395e84a None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:24.790600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853475-7746-4989-86e8-52350395e84a None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:24.791111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853475-7746-4989-86e8-52350395e84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:24.792708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853475-7746-4989-86e8-52350395e84a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:24.804622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 99/215] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:24.810846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853475-7746-4989-86e8-52350395e84a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:24.819522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 117/216] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:34:24 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:34:24.925939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:24.949451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853475-7746-4989-86e8-52350395e84a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:25.013308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34f102-a57e-4009-8bfc-617dd29f9bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:25.014535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34f102-a57e-4009-8bfc-617dd29f9bd9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:25.015028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34f102-a57e-4009-8bfc-617dd29f9bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:25.015506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34f102-a57e-4009-8bfc-617dd29f9bd9 None admin] PATH_INFO: `/v3/users/97eb68feeb2343eeb77eea1d61683cbc` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:25.040830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34f102-a57e-4009-8bfc-617dd29f9bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=97eb68feeb2343eeb77eea1d61683cbc)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:25.045816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34f102-a57e-4009-8bfc-617dd29f9bd9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:25.045816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 100/217] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:24 2022] GET /identity/v3/users/97eb68feeb2343eeb77eea1d61683cbc => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:25.051917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9be88-ba62-49b1-be25-928ab946a751 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:25.130146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:25.226555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9be88-ba62-49b1-be25-928ab946a751 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:25.270740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449ad6-592b-4146-ad26-8580419df082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:25.271405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449ad6-592b-4146-ad26-8580419df082 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:25.271683 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449ad6-592b-4146-ad26-8580419df082 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:25.271953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449ad6-592b-4146-ad26-8580419df082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:25.361075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce449ad6-592b-4146-ad26-8580419df082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:25.362612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce449ad6-592b-4146-ad26-8580419df082 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:25.444896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:25.474896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 118/218] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:25.480663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34f102-a57e-4009-8bfc-617dd29f9bd9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:25.617124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34f102-a57e-4009-8bfc-617dd29f9bd9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:25.662082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424bc59-f511-4b5b-bb13-9703004281de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:25.662736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424bc59-f511-4b5b-bb13-9703004281de None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:25.663021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424bc59-f511-4b5b-bb13-9703004281de None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:25.663297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424bc59-f511-4b5b-bb13-9703004281de None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:25.664502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424bc59-f511-4b5b-bb13-9703004281de None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:25.666002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424bc59-f511-4b5b-bb13-9703004281de None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:25.667847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 101/219] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:25 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:25.674002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449ad6-592b-4146-ad26-8580419df082 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:25.876624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449ad6-592b-4146-ad26-8580419df082 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:25.934029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f620cdf-72c8-4d01-950d-7feeee502373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:25.934673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620cdf-72c8-4d01-950d-7feeee502373 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:25.934950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620cdf-72c8-4d01-950d-7feeee502373 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:25.935222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f620cdf-72c8-4d01-950d-7feeee502373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:25.936031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f620cdf-72c8-4d01-950d-7feeee502373 None admin] RBAC: Adding query filter params (role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=05e3776e5294421c871d6041b669b876, user.id=97eb68feeb2343eeb77eea1d61683cbc) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:25.936344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f620cdf-72c8-4d01-950d-7feeee502373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:25.937889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f620cdf-72c8-4d01-950d-7feeee502373 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:25.951259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 119/220] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:25 2022] GET /identity/v3/role_assignments?user.id=97eb68feeb2343eeb77eea1d61683cbc&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:26.053264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cb78c-b60d-431c-95d4-6c409f6f97e5 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:26.054056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cb78c-b60d-431c-95d4-6c409f6f97e5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:26.054370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cb78c-b60d-431c-95d4-6c409f6f97e5 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:26.056390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 102/221] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:26.064765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9c96-1ae4-48e5-829d-112c3a4fa55e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:26.065476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9c96-1ae4-48e5-829d-112c3a4fa55e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:26.065476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df9c96-1ae4-48e5-829d-112c3a4fa55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:26.091099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7f3e5-0ed1-4a01-919a-b262de91de12 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:26.091516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7f3e5-0ed1-4a01-919a-b262de91de12 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:26.091687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7f3e5-0ed1-4a01-919a-b262de91de12 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:26.093251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 103/222] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:34:26.096563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f0df9c96-1ae4-48e5-829d-112c3a4fa55e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:26.097874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f0df9c96-1ae4-48e5-829d-112c3a4fa55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:26.102451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a246-2f04-4d59-99e2-44bb5b96a600 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:26.102837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a246-2f04-4d59-99e2-44bb5b96a600 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:26.103076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a246-2f04-4d59-99e2-44bb5b96a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:26.117996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:26.122029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:26.139864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c002a246-2f04-4d59-99e2-44bb5b96a600 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:26.144319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c002a246-2f04-4d59-99e2-44bb5b96a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:26.284233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 120/223] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:26.297940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 104/224] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:26.812552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df9c96-1ae4-48e5-829d-112c3a4fa55e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:26.844795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a246-2f04-4d59-99e2-44bb5b96a600 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:27.100543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df9c96-1ae4-48e5-829d-112c3a4fa55e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:27.102252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a246-2f04-4d59-99e2-44bb5b96a600 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:27.163624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f818e2d-bfbc-4865-92af-569770e3a7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:27.164308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f818e2d-bfbc-4865-92af-569770e3a7f5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:27.164592 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f818e2d-bfbc-4865-92af-569770e3a7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:27.164861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f818e2d-bfbc-4865-92af-569770e3a7f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:27.177862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f818e2d-bfbc-4865-92af-569770e3a7f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-4f818e2d-bfbc-4865-92af-569770e3a7f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:27.183964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:27.185694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:27.187028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 121/225] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:27.196119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f818e2d-bfbc-4865-92af-569770e3a7f5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:27.205929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:27.239476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d49f0-bd13-4f38-bfd7-62bdce87b804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:27.240541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d49f0-bd13-4f38-bfd7-62bdce87b804 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:27.241033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d49f0-bd13-4f38-bfd7-62bdce87b804 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:27.241545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d49f0-bd13-4f38-bfd7-62bdce87b804 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:27.251384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:27.273890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d49f0-bd13-4f38-bfd7-62bdce87b804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-0c5d49f0-bd13-4f38-bfd7-62bdce87b804 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:27.289331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:27.290992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:27.292407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 105/226] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:34:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:34:27.299530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d49f0-bd13-4f38-bfd7-62bdce87b804 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:27.505903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f818e2d-bfbc-4865-92af-569770e3a7f5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:27.581525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:27.583068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:27.583846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:27.584568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:27.586058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:27.586867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:27.589789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:27.605841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d49f0-bd13-4f38-bfd7-62bdce87b804 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:27.606330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 122/227] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:27.616353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:27.670271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:27.670821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:27.671101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:27.671376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:27.672073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:27.672384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:27.673890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:27.691328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 106/228] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:27.697698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:27.788585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:27.864622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:27.915294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59f3e2-4792-46a4-9f87-f0bd1c238fab None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:28.000868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897e23a-c072-43dd-8f8d-dbaf309afd8d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:28.012452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a895b1d-91ca-4548-9129-d7db0c4babc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:28.013120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895b1d-91ca-4548-9129-d7db0c4babc9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.013402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895b1d-91ca-4548-9129-d7db0c4babc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.013706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a895b1d-91ca-4548-9129-d7db0c4babc9 None admin] PATH_INFO: `/v3/users/bef6d6838ddd417ab9e892938b66e808` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.016826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a895b1d-91ca-4548-9129-d7db0c4babc9 None admin] RBAC: Authorizing `identity:get_user(user_id=bef6d6838ddd417ab9e892938b66e808)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:28.019076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a895b1d-91ca-4548-9129-d7db0c4babc9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:28.022006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 123/229] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:27 2022] GET /identity/v3/users/bef6d6838ddd417ab9e892938b66e808 => generated 283 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:28.027041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51dde0-8452-45e1-ba54-505508b6cdf5 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.027549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51dde0-8452-45e1-ba54-505508b6cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.027968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51dde0-8452-45e1-ba54-505508b6cdf5 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.032196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 124/230] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:28.034707 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51dde0-8452-45e1-ba54-505508b6cdf5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:28.047885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee561fa2-6a63-4eaa-a110-a6b24b2876a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:28.048792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561fa2-6a63-4eaa-a110-a6b24b2876a9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.049753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561fa2-6a63-4eaa-a110-a6b24b2876a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.050293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee561fa2-6a63-4eaa-a110-a6b24b2876a9 None admin] PATH_INFO: `/v3/users/bef6d6838ddd417ab9e892938b66e808` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.052445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee561fa2-6a63-4eaa-a110-a6b24b2876a9 None admin] RBAC: Authorizing `identity:get_user(user_id=bef6d6838ddd417ab9e892938b66e808)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:28.054919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee561fa2-6a63-4eaa-a110-a6b24b2876a9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:28.061635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 107/231] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:27 2022] GET /identity/v3/users/bef6d6838ddd417ab9e892938b66e808 => generated 283 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:28.061635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbfcb3-fd28-4d12-92dc-e30f479d9582 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.061635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbfcb3-fd28-4d12-92dc-e30f479d9582 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.061635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbfcb3-fd28-4d12-92dc-e30f479d9582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.088463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4fbbfcb3-fd28-4d12-92dc-e30f479d9582 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:28.090001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4fbbfcb3-fd28-4d12-92dc-e30f479d9582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:28.173173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51dde0-8452-45e1-ba54-505508b6cdf5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:28.193022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 108/232] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:28.194132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbfcb3-fd28-4d12-92dc-e30f479d9582 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:28.226702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fbacb-0b64-4205-a21b-47cdefbe61e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:28.227500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fbacb-0b64-4205-a21b-47cdefbe61e7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.227962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fbacb-0b64-4205-a21b-47cdefbe61e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.228426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fbacb-0b64-4205-a21b-47cdefbe61e7 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.230886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fbacb-0b64-4205-a21b-47cdefbe61e7 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:28.233027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fbacb-0b64-4205-a21b-47cdefbe61e7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:28.235163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 125/233] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:28 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:28.236604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a635182-cde9-494e-9fa7-4ab1dbf8c92a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.237065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a635182-cde9-494e-9fa7-4ab1dbf8c92a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.237469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a635182-cde9-494e-9fa7-4ab1dbf8c92a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.239026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 126/234] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:28.248907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a635182-cde9-494e-9fa7-4ab1dbf8c92a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:28.253841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:28.296632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:28.405321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbfcb3-fd28-4d12-92dc-e30f479d9582 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:28.413955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a635182-cde9-494e-9fa7-4ab1dbf8c92a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:28.465961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36226-6872-40fd-bf57-edb7322efd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:28.467422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36226-6872-40fd-bf57-edb7322efd54 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.468135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36226-6872-40fd-bf57-edb7322efd54 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.469063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36226-6872-40fd-bf57-edb7322efd54 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876/users/bef6d6838ddd417ab9e892938b66e808/roles/0adab6046ed34edf8914c4971198655f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.473997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c36226-6872-40fd-bf57-edb7322efd54 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e3776e5294421c871d6041b669b876, user_id=bef6d6838ddd417ab9e892938b66e808, role_id=0adab6046ed34edf8914c4971198655f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:28.476889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c36226-6872-40fd-bf57-edb7322efd54 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:28.478552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d14db5-b3b9-435e-b9f2-e69d0faa0082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:28.479486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d14db5-b3b9-435e-b9f2-e69d0faa0082 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.479967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d14db5-b3b9-435e-b9f2-e69d0faa0082 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.480499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d14db5-b3b9-435e-b9f2-e69d0faa0082 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.481953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d14db5-b3b9-435e-b9f2-e69d0faa0082 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:28.483986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d14db5-b3b9-435e-b9f2-e69d0faa0082 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:28.486249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 109/235] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:28 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:28.487823 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665deb-2499-462c-9afb-e8a8731a0f68 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.488353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665deb-2499-462c-9afb-e8a8731a0f68 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.488880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665deb-2499-462c-9afb-e8a8731a0f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.502478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 127/236] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:28 2022] PUT /identity/v3/projects/05e3776e5294421c871d6041b669b876/users/bef6d6838ddd417ab9e892938b66e808/roles/0adab6046ed34edf8914c4971198655f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:28.510776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36226-6872-40fd-bf57-edb7322efd54 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:28.511978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d2665deb-2499-462c-9afb-e8a8731a0f68 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:28.513271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d2665deb-2499-462c-9afb-e8a8731a0f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:28.611793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:28.621734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 110/237] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:28.623137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2665deb-2499-462c-9afb-e8a8731a0f68 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:28.670530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36226-6872-40fd-bf57-edb7322efd54 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:28.719753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:28.720910 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e30b0-9c4f-4678-a6c6-2dc89a791e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:28.721717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e30b0-9c4f-4678-a6c6-2dc89a791e90 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.722063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e30b0-9c4f-4678-a6c6-2dc89a791e90 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.722358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e30b0-9c4f-4678-a6c6-2dc89a791e90 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876/users/bef6d6838ddd417ab9e892938b66e808/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.726445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e30b0-9c4f-4678-a6c6-2dc89a791e90 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e3776e5294421c871d6041b669b876, user_id=bef6d6838ddd417ab9e892938b66e808, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:28.728334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e30b0-9c4f-4678-a6c6-2dc89a791e90 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:28.745459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 128/238] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:28 2022] PUT /identity/v3/projects/05e3776e5294421c871d6041b669b876/users/bef6d6838ddd417ab9e892938b66e808/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:28.799692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2665deb-2499-462c-9afb-e8a8731a0f68 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:28.843339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adda0b-26c7-4a9d-91e2-8b2acf7b7792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:28.844542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adda0b-26c7-4a9d-91e2-8b2acf7b7792 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:28.845035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adda0b-26c7-4a9d-91e2-8b2acf7b7792 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:28.845511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adda0b-26c7-4a9d-91e2-8b2acf7b7792 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:28.860792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adda0b-26c7-4a9d-91e2-8b2acf7b7792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-79adda0b-26c7-4a9d-91e2-8b2acf7b7792 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:28.866717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:28.867673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:28.868470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:28.870940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 111/239] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:28.877154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e30b0-9c4f-4678-a6c6-2dc89a791e90 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:28.984530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adda0b-26c7-4a9d-91e2-8b2acf7b7792 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:29.015589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e30b0-9c4f-4678-a6c6-2dc89a791e90 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:29.046250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:29.062161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:29.063149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:29.063713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:29.064226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:29.065161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:29.065759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:29.067846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:29.078995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 129/240] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:29.086047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:29.203355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adda0b-26c7-4a9d-91e2-8b2acf7b7792 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:29.221262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:29.249111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe718fc-416d-4cd3-8853-97349f726d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:29.249317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fff85a-3039-4f5c-b6cb-336dd0ea1025 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:29.250665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe718fc-416d-4cd3-8853-97349f726d87 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:29.251171 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe718fc-416d-4cd3-8853-97349f726d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:29.251651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe718fc-416d-4cd3-8853-97349f726d87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:29.253329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe718fc-416d-4cd3-8853-97349f726d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:29.255244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe718fc-416d-4cd3-8853-97349f726d87 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:29.257827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 112/241] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:29.266667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe718fc-416d-4cd3-8853-97349f726d87 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:29.307296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359d31-9390-419c-8cf1-1d37927e9d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:29.307968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359d31-9390-419c-8cf1-1d37927e9d1a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:29.308249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359d31-9390-419c-8cf1-1d37927e9d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:29.308517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359d31-9390-419c-8cf1-1d37927e9d1a None admin] PATH_INFO: `/v3/users/79abaa8e2d5c428c9b74d0fbca97b35e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:29.335823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7359d31-9390-419c-8cf1-1d37927e9d1a None admin] RBAC: Authorizing `identity:get_user(user_id=79abaa8e2d5c428c9b74d0fbca97b35e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:29.337646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7359d31-9390-419c-8cf1-1d37927e9d1a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:29.339466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 130/242] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:29 2022] GET /identity/v3/users/79abaa8e2d5c428c9b74d0fbca97b35e => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:29.347891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359d31-9390-419c-8cf1-1d37927e9d1a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:29.419355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:29.445349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe718fc-416d-4cd3-8853-97349f726d87 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:29.522137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e562b-3d33-4091-8bc0-ec29df5ea13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:29.522775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e562b-3d33-4091-8bc0-ec29df5ea13b None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:29.523057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e562b-3d33-4091-8bc0-ec29df5ea13b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:29.523330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e562b-3d33-4091-8bc0-ec29df5ea13b None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:29.524017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e562b-3d33-4091-8bc0-ec29df5ea13b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:29.525562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e562b-3d33-4091-8bc0-ec29df5ea13b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:29.545847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359d31-9390-419c-8cf1-1d37927e9d1a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:29.588965 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 113/243] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:34:29 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:34:29.596012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c6110-bd04-439f-b13c-04fd20aade4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:29.596655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c6110-bd04-439f-b13c-04fd20aade4d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:29.596937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c6110-bd04-439f-b13c-04fd20aade4d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:29.597210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c6110-bd04-439f-b13c-04fd20aade4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:29.658711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5d8c-89a4-4707-ac63-ec18ed74d102 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:29.659364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5d8c-89a4-4707-ac63-ec18ed74d102 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:29.659889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b5d8c-89a4-4707-ac63-ec18ed74d102 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:29.662227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 114/244] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:29.670571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da9fc4-6734-4a58-9eb8-21e23eafedf8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:29.670855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da9fc4-6734-4a58-9eb8-21e23eafedf8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:29.671131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da9fc4-6734-4a58-9eb8-21e23eafedf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:29.691602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c6110-bd04-439f-b13c-04fd20aade4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:29.693351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c6110-bd04-439f-b13c-04fd20aade4d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:29.718805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-00da9fc4-6734-4a58-9eb8-21e23eafedf8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:29.720040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-00da9fc4-6734-4a58-9eb8-21e23eafedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:29.747082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:29.801221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:29.811062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 131/245] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:29.817474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c6110-bd04-439f-b13c-04fd20aade4d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:29.911476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 115/246] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:29.934219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c6110-bd04-439f-b13c-04fd20aade4d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:29.973682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3249c-28e2-499c-be17-bbce784177b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:29.974351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3249c-28e2-499c-be17-bbce784177b0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:29.974629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3249c-28e2-499c-be17-bbce784177b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:29.974903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3249c-28e2-499c-be17-bbce784177b0 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:29.976151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3249c-28e2-499c-be17-bbce784177b0 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:29.977728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3249c-28e2-499c-be17-bbce784177b0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:29.979817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 132/247] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:29 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:29.985797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da9fc4-6734-4a58-9eb8-21e23eafedf8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:30.126244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da9fc4-6734-4a58-9eb8-21e23eafedf8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:30.173978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:30.174538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:30.174822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:30.175098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:30.175898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] RBAC: Adding query filter params (role.id=1bf206c740ba4f59b66a1cc010f7aee9, scope.project.id=05e3776e5294421c871d6041b669b876, user.id=79abaa8e2d5c428c9b74d0fbca97b35e) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:30.176279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:30.177870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:30.184408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 116/248] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:29 2022] GET /identity/v3/role_assignments?user.id=79abaa8e2d5c428c9b74d0fbca97b35e&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=1bf206c740ba4f59b66a1cc010f7aee9 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:30.371388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3249c-28e2-499c-be17-bbce784177b0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:30.398095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:30.555529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3249c-28e2-499c-be17-bbce784177b0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:30.599066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c05039-3bf9-4f37-922e-ea1c92a19e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:30.600164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c05039-3bf9-4f37-922e-ea1c92a19e3f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:30.600680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c05039-3bf9-4f37-922e-ea1c92a19e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:30.601180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c05039-3bf9-4f37-922e-ea1c92a19e3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:30.615886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c05039-3bf9-4f37-922e-ea1c92a19e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d4c05039-3bf9-4f37-922e-ea1c92a19e3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:30.621229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:30.622213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:30.622978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:30.625378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 133/249] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:30.632502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:30.685647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:30.785135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550d2a0-3f50-4efe-811b-78429849b093 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:30.837403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:30.838405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:30.838897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:30.839403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:30.840337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:30.840855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:30.842541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:30.855481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 117/250] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:30.861771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c05039-3bf9-4f37-922e-ea1c92a19e3f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:31.010899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:31.055322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c05039-3bf9-4f37-922e-ea1c92a19e3f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:31.096500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29d724-2cba-4f32-8bcf-0431d3601dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:31.097061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29d724-2cba-4f32-8bcf-0431d3601dbe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:31.097357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29d724-2cba-4f32-8bcf-0431d3601dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:31.097657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29d724-2cba-4f32-8bcf-0431d3601dbe None admin] PATH_INFO: `/v3/users/97eb68feeb2343eeb77eea1d61683cbc` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:31.099661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29d724-2cba-4f32-8bcf-0431d3601dbe None admin] RBAC: Authorizing `identity:get_user(user_id=97eb68feeb2343eeb77eea1d61683cbc)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:31.101190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29d724-2cba-4f32-8bcf-0431d3601dbe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:31.103266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 134/251] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:30 2022] GET /identity/v3/users/97eb68feeb2343eeb77eea1d61683cbc => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:31.109040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:31.238266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:31.247946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca528e-3df6-4442-aed3-15a40a0a9c21 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:31.303640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cba1d-5ff3-4346-900c-de36c849470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:31.304318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cba1d-5ff3-4346-900c-de36c849470a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:31.304592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cba1d-5ff3-4346-900c-de36c849470a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:31.304874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cba1d-5ff3-4346-900c-de36c849470a None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:31.306227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cba1d-5ff3-4346-900c-de36c849470a None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:31.307758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cba1d-5ff3-4346-900c-de36c849470a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:31.309844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 118/252] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:31 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:31.315879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29d724-2cba-4f32-8bcf-0431d3601dbe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:31.475436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29d724-2cba-4f32-8bcf-0431d3601dbe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:31.534565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0c64c-61b3-481c-9283-f8310e613d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:31.535285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c64c-61b3-481c-9283-f8310e613d2f None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:31.536126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c64c-61b3-481c-9283-f8310e613d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:31.536406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c64c-61b3-481c-9283-f8310e613d2f None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876/users/97eb68feeb2343eeb77eea1d61683cbc/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:31.538892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0c64c-61b3-481c-9283-f8310e613d2f None admin] RBAC: Authorizing `identity:create_grant(project_id=05e3776e5294421c871d6041b669b876, user_id=97eb68feeb2343eeb77eea1d61683cbc, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:31.540518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0c64c-61b3-481c-9283-f8310e613d2f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:31.567705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:31.573700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 135/253] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:31 2022] PUT /identity/v3/projects/05e3776e5294421c871d6041b669b876/users/97eb68feeb2343eeb77eea1d61683cbc/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:34:31.657959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95389a7d-6d88-4637-a8cf-5d2c4db93651 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:31.658935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95389a7d-6d88-4637-a8cf-5d2c4db93651 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:31.658935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95389a7d-6d88-4637-a8cf-5d2c4db93651 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:31.660005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 119/254] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:31.667131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c44cb-c05b-43f3-ad1a-f516d69ea398 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:31.667515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c44cb-c05b-43f3-ad1a-f516d69ea398 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:31.667755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c44cb-c05b-43f3-ad1a-f516d69ea398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:31.694848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c17c44cb-c05b-43f3-ad1a-f516d69ea398 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:31.696142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c17c44cb-c05b-43f3-ad1a-f516d69ea398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:31.791683 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 136/255] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:31.820188 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb987c-bede-456e-a470-f773d7aaa12c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:31.820592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb987c-bede-456e-a470-f773d7aaa12c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:31.820817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb987c-bede-456e-a470-f773d7aaa12c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:31.822223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 120/256] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:31.828413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1cd6c-6780-4e0b-95e9-12297cb9d437 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:31.828829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1cd6c-6780-4e0b-95e9-12297cb9d437 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:31.829054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1cd6c-6780-4e0b-95e9-12297cb9d437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:31.858846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c8e1cd6c-6780-4e0b-95e9-12297cb9d437 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:31.860094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c8e1cd6c-6780-4e0b-95e9-12297cb9d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:31.947214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 137/257] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:32.235115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb987c-bede-456e-a470-f773d7aaa12c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:32.340031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1cd6c-6780-4e0b-95e9-12297cb9d437 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:32.428857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb987c-bede-456e-a470-f773d7aaa12c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:32.507993 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:32.512692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed8c1d-e373-463d-a8e7-48366acb6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:32.513353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed8c1d-e373-463d-a8e7-48366acb6691 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:32.513684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed8c1d-e373-463d-a8e7-48366acb6691 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:32.513982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed8c1d-e373-463d-a8e7-48366acb6691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:32.533554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed8c1d-e373-463d-a8e7-48366acb6691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f1ed8c1d-e373-463d-a8e7-48366acb6691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:32.538714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:32.539632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:32.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:32.541657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 121/258] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:32.549391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed8c1d-e373-463d-a8e7-48366acb6691 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:32.601558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:32.630147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1cd6c-6780-4e0b-95e9-12297cb9d437 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:32.744294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a4dd-8338-450b-86be-538d54d5e0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:32.744964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a4dd-8338-450b-86be-538d54d5e0b2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:32.745244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a4dd-8338-450b-86be-538d54d5e0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:32.745513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a4dd-8338-450b-86be-538d54d5e0b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:32.767326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5a4dd-8338-450b-86be-538d54d5e0b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:32.774615 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed8c1d-e373-463d-a8e7-48366acb6691 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-25a5a4dd-8338-450b-86be-538d54d5e0b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:32.776265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:32.777135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:32.778671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 138/259] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:32.786567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a4dd-8338-450b-86be-538d54d5e0b2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:32.862112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:32.862757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:32.863046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:32.863330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:32.864975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:32.865297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:32.866846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:32.887278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 122/260] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:32.893631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:33.086886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:33.118447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a4dd-8338-450b-86be-538d54d5e0b2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:33.129988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f7eee-a0fc-4250-a4b9-f63071973e48 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:33.174968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:33.203754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407d6a-bffb-4fd5-920c-7f6f81a1235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:33.204772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407d6a-bffb-4fd5-920c-7f6f81a1235a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:33.205272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407d6a-bffb-4fd5-920c-7f6f81a1235a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:33.205795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407d6a-bffb-4fd5-920c-7f6f81a1235a None admin] PATH_INFO: `/v3/users/bef6d6838ddd417ab9e892938b66e808` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:33.210877 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407d6a-bffb-4fd5-920c-7f6f81a1235a None admin] RBAC: Authorizing `identity:get_user(user_id=bef6d6838ddd417ab9e892938b66e808)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:33.211809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:33.212446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:33.212730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:33.213009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:33.213542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407d6a-bffb-4fd5-920c-7f6f81a1235a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:33.213748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:33.214046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:33.215449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:33.216946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 123/261] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:32 2022] GET /identity/v3/users/bef6d6838ddd417ab9e892938b66e808 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:33.222637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407d6a-bffb-4fd5-920c-7f6f81a1235a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:33.230158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 139/262] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:33.236122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:33.398994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673f8be-2880-4d69-b2c0-824a0765ff8b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:33.458577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ccf8-e393-4201-8373-51327ea1491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:33.459484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ccf8-e393-4201-8373-51327ea1491e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:33.459914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ccf8-e393-4201-8373-51327ea1491e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:33.460333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5ccf8-e393-4201-8373-51327ea1491e None admin] PATH_INFO: `/v3/users/bef6d6838ddd417ab9e892938b66e808` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:33.461770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5ccf8-e393-4201-8373-51327ea1491e None admin] RBAC: Authorizing `identity:get_user(user_id=bef6d6838ddd417ab9e892938b66e808)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:33.463374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5ccf8-e393-4201-8373-51327ea1491e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:33.465316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 140/263] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:33 2022] GET /identity/v3/users/bef6d6838ddd417ab9e892938b66e808 => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:33.471105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ccf8-e393-4201-8373-51327ea1491e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:33.558409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407d6a-bffb-4fd5-920c-7f6f81a1235a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:33.560079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:33.647304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203c10a-925b-4430-a056-d7c91b49ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:33.647943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203c10a-925b-4430-a056-d7c91b49ef1d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:33.648233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203c10a-925b-4430-a056-d7c91b49ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:33.648515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203c10a-925b-4430-a056-d7c91b49ef1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:33.657883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5ccf8-e393-4201-8373-51327ea1491e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:33.713651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:33.715797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8358ac1-5b4b-4639-90ca-d97587343cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:33.716430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358ac1-5b4b-4639-90ca-d97587343cbd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:33.716726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358ac1-5b4b-4639-90ca-d97587343cbd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:33.716981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358ac1-5b4b-4639-90ca-d97587343cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:33.806118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203c10a-925b-4430-a056-d7c91b49ef1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:33.807645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203c10a-925b-4430-a056-d7c91b49ef1d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:33.834648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8358ac1-5b4b-4639-90ca-d97587343cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:33.836189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8358ac1-5b4b-4639-90ca-d97587343cbd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:33.994088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:34.079118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 124/264] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 12:34:34.087363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203c10a-925b-4430-a056-d7c91b49ef1d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:34.138707 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 141/265] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 12:34:34.140049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9eb3-a8b0-402f-b3e9-d53aef2eb6b3 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:34.140343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9eb3-a8b0-402f-b3e9-d53aef2eb6b3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:34.141283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9eb3-a8b0-402f-b3e9-d53aef2eb6b3 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:34.142731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 142/266] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:34.148702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9eb3-a8b0-402f-b3e9-d53aef2eb6b3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:34.209921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:34.294034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203c10a-925b-4430-a056-d7c91b49ef1d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:34.309308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9eb3-a8b0-402f-b3e9-d53aef2eb6b3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:34.364957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d89ac0-6784-42c9-a236-73875fc1f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:34.366614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89ac0-6784-42c9-a236-73875fc1f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:34.367155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89ac0-6784-42c9-a236-73875fc1f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:34.367439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89ac0-6784-42c9-a236-73875fc1f9c7 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:34.369127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d89ac0-6784-42c9-a236-73875fc1f9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:34.374149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d89ac0-6784-42c9-a236-73875fc1f9c7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:34.375529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf00d-11e7-41f9-b8ad-8e86df180527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:34.376969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf00d-11e7-41f9-b8ad-8e86df180527 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:34.377805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf00d-11e7-41f9-b8ad-8e86df180527 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:34.378135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 143/267] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:34 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:34.379661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf00d-11e7-41f9-b8ad-8e86df180527 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:34.380974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a608-f0b0-4b64-a68a-511dd42e50cd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:34.381300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a608-f0b0-4b64-a68a-511dd42e50cd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:34.381694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a608-f0b0-4b64-a68a-511dd42e50cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:34.382814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf00d-11e7-41f9-b8ad-8e86df180527 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:34.385977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf00d-11e7-41f9-b8ad-8e86df180527 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:34.389670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 125/268] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:34 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:34.392501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70029-ae87-486d-9d55-1859eed448e4 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:34.393404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70029-ae87-486d-9d55-1859eed448e4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:34.394594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70029-ae87-486d-9d55-1859eed448e4 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:34.398088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 126/269] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:34.406727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70029-ae87-486d-9d55-1859eed448e4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:34.418056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-13f0a608-f0b0-4b64-a68a-511dd42e50cd None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:34.419317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-13f0a608-f0b0-4b64-a68a-511dd42e50cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:34.440265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:34.519094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 144/270] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:34.519671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0a608-f0b0-4b64-a68a-511dd42e50cd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:34.676725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70029-ae87-486d-9d55-1859eed448e4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:34.746585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:34.776332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0a608-f0b0-4b64-a68a-511dd42e50cd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:34.780444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479119f-2fc4-4baf-9886-9b99f2c17582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:34.782160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479119f-2fc4-4baf-9886-9b99f2c17582 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:34.783069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479119f-2fc4-4baf-9886-9b99f2c17582 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:34.783803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479119f-2fc4-4baf-9886-9b99f2c17582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:34.786310 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479119f-2fc4-4baf-9886-9b99f2c17582 None admin] RBAC: Adding query filter params (role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=05e3776e5294421c871d6041b669b876, user.id=bef6d6838ddd417ab9e892938b66e808) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:34.787165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479119f-2fc4-4baf-9886-9b99f2c17582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:34.790379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479119f-2fc4-4baf-9886-9b99f2c17582 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:34.803505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 127/271] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:34 2022] GET /identity/v3/role_assignments?user.id=bef6d6838ddd417ab9e892938b66e808&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=0adab6046ed34edf8914c4971198655f => generated 608 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:34.806577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029610-ad47-4b2d-9200-4895e412cf17 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:34.808244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029610-ad47-4b2d-9200-4895e412cf17 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:34.808969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029610-ad47-4b2d-9200-4895e412cf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:34.842589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c2029610-ad47-4b2d-9200-4895e412cf17 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:34.845183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c2029610-ad47-4b2d-9200-4895e412cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:34.883645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e1407-b872-440f-a548-cd02042e7aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:34.884278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1407-b872-440f-a548-cd02042e7aa8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:34.884559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1407-b872-440f-a548-cd02042e7aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:34.884834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1407-b872-440f-a548-cd02042e7aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:34.885590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e1407-b872-440f-a548-cd02042e7aa8 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=05e3776e5294421c871d6041b669b876, user.id=bef6d6838ddd417ab9e892938b66e808) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:34.886408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e1407-b872-440f-a548-cd02042e7aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:34.887403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e1407-b872-440f-a548-cd02042e7aa8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:34.905621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 145/272] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:34 2022] GET /identity/v3/role_assignments?user.id=bef6d6838ddd417ab9e892938b66e808&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=b8bf66974c0448089a192ead432a35f2 => generated 608 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:34.996175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 128/273] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:35.063199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6d9f-c8f2-4e75-90e3-53b0bab718be None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.063460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6d9f-c8f2-4e75-90e3-53b0bab718be None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.063880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6d9f-c8f2-4e75-90e3-53b0bab718be None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.065649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 146/274] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:35.086223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248600d-8f6f-4df3-be21-c624281f5fc5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.086686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248600d-8f6f-4df3-be21-c624281f5fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.086819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248600d-8f6f-4df3-be21-c624281f5fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.087683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d295-d2ce-4f98-ba09-15c9bf7cedac None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.088392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d295-d2ce-4f98-ba09-15c9bf7cedac None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.089071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427d295-d2ce-4f98-ba09-15c9bf7cedac None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.091698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 129/275] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:35.099471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d977-bc13-4cc1-ae4f-a8c102c2d2ad None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.100347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d977-bc13-4cc1-ae4f-a8c102c2d2ad None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.101300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d977-bc13-4cc1-ae4f-a8c102c2d2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.119016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4248600d-8f6f-4df3-be21-c624281f5fc5 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:35.120300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4248600d-8f6f-4df3-be21-c624281f5fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:35.124280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:35.150167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ada3d977-bc13-4cc1-ae4f-a8c102c2d2ad None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:35.153454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ada3d977-bc13-4cc1-ae4f-a8c102c2d2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:35.266519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 147/276] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:35.267329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248600d-8f6f-4df3-be21-c624281f5fc5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:35.280619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 130/277] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:35.448394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248600d-8f6f-4df3-be21-c624281f5fc5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:35.462652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d977-bc13-4cc1-ae4f-a8c102c2d2ad None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:35.499901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dcef7-1ec7-4409-ac43-b070e992f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:35.500558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dcef7-1ec7-4409-ac43-b070e992f627 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.500835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dcef7-1ec7-4409-ac43-b070e992f627 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.501105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dcef7-1ec7-4409-ac43-b070e992f627 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.502292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dcef7-1ec7-4409-ac43-b070e992f627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:35.503754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dcef7-1ec7-4409-ac43-b070e992f627 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:35.506175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 148/278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:35.512580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dcef7-1ec7-4409-ac43-b070e992f627 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:35.525959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:35.573976 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:35.633590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dcef7-1ec7-4409-ac43-b070e992f627 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:35.676341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8af95-70ae-45ed-90fb-4d37496a1de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:35.677148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8af95-70ae-45ed-90fb-4d37496a1de5 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.677286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8af95-70ae-45ed-90fb-4d37496a1de5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.677496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8af95-70ae-45ed-90fb-4d37496a1de5 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.678697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8af95-70ae-45ed-90fb-4d37496a1de5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:35.680595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8af95-70ae-45ed-90fb-4d37496a1de5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:35.680922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d977-bc13-4cc1-ae4f-a8c102c2d2ad None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:35.708133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 149/279] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:34:35 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:34:35.710250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8af95-70ae-45ed-90fb-4d37496a1de5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:35.743196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672f48-469f-4cf0-acef-7f4e0ee66d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:35.744289 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672f48-469f-4cf0-acef-7f4e0ee66d4b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.744766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672f48-469f-4cf0-acef-7f4e0ee66d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.745191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672f48-469f-4cf0-acef-7f4e0ee66d4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.765264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9672f48-469f-4cf0-acef-7f4e0ee66d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e9672f48-469f-4cf0-acef-7f4e0ee66d4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:35.775459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:35.776491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:35.777301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:35.777930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 131/280] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:35.783758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672f48-469f-4cf0-acef-7f4e0ee66d4b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:35.807184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:35.860814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8af95-70ae-45ed-90fb-4d37496a1de5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:35.910503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671ad4-dd55-4fbf-9bc6-9ed3ed6413a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:35.911724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671ad4-dd55-4fbf-9bc6-9ed3ed6413a3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.912620 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671ad4-dd55-4fbf-9bc6-9ed3ed6413a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.913060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671ad4-dd55-4fbf-9bc6-9ed3ed6413a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.930410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672f48-469f-4cf0-acef-7f4e0ee66d4b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:35.931348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52671ad4-dd55-4fbf-9bc6-9ed3ed6413a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:35.933968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-52671ad4-dd55-4fbf-9bc6-9ed3ed6413a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:35.936944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:35.938604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:35.941135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 150/281] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:35.945525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671ad4-dd55-4fbf-9bc6-9ed3ed6413a3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:35.984989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:35.985631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:35.986713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:35.986713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:35.986977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:35.987228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:35.989022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:35.999625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 132/282] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:36.005683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:36.094889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671ad4-dd55-4fbf-9bc6-9ed3ed6413a3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:36.132935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:36.146004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eac0a-6b01-4330-b002-d5162027bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:36.146270 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eac0a-6b01-4330-b002-d5162027bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:36.146408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eac0a-6b01-4330-b002-d5162027bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:36.146693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eac0a-6b01-4330-b002-d5162027bfa1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:36.161269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834eac0a-6b01-4330-b002-d5162027bfa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-834eac0a-6b01-4330-b002-d5162027bfa1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:36.167809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:36.169489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 151/283] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:36.171094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eac0a-6b01-4330-b002-d5162027bfa1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:36.179404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470afff4-cfcd-4a5c-a42e-74a0b3d8c44d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:36.222555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:36.223377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:36.223662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:36.223971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:36.224659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:36.224974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:36.226536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:36.236521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 133/284] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:36.237515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:36.281687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:36.378913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eac0a-6b01-4330-b002-d5162027bfa1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:36.434543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50cc85-518b-4d13-8e53-fc2263d509e0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:36.444239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82705a-499d-42ad-8d3f-3274c1379cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:36.444917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82705a-499d-42ad-8d3f-3274c1379cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:36.445204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82705a-499d-42ad-8d3f-3274c1379cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:36.445492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82705a-499d-42ad-8d3f-3274c1379cf7 None admin] PATH_INFO: `/v3/users/79abaa8e2d5c428c9b74d0fbca97b35e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:36.447038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82705a-499d-42ad-8d3f-3274c1379cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=79abaa8e2d5c428c9b74d0fbca97b35e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:36.448564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82705a-499d-42ad-8d3f-3274c1379cf7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:36.457634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 152/285] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:36 2022] GET /identity/v3/users/79abaa8e2d5c428c9b74d0fbca97b35e => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:36.457634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82705a-499d-42ad-8d3f-3274c1379cf7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:36.499512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:36.499814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:36.500162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:36.500304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:36.501031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:36.501343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:36.502863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:36.520597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 134/286] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:36.520597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:36.558864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:36.629669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82705a-499d-42ad-8d3f-3274c1379cf7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:36.649199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:36.662107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7e5ce-d95c-4993-9705-97c7e1ecd1ab None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:36.676884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d07c8-1c4e-4e47-9ace-9e9a790fd002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:36.677553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d07c8-1c4e-4e47-9ace-9e9a790fd002 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:36.677866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d07c8-1c4e-4e47-9ace-9e9a790fd002 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:36.678150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d07c8-1c4e-4e47-9ace-9e9a790fd002 None admin] PATH_INFO: `/v3/users/57b17ce2bb0f4c2c8365fdf17592c69c` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:36.695207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d07c8-1c4e-4e47-9ace-9e9a790fd002 None admin] RBAC: Authorizing `identity:get_user(user_id=57b17ce2bb0f4c2c8365fdf17592c69c)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:36.697573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d07c8-1c4e-4e47-9ace-9e9a790fd002 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:36.704331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 153/287] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:36 2022] GET /identity/v3/users/57b17ce2bb0f4c2c8365fdf17592c69c => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:36.704331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d07c8-1c4e-4e47-9ace-9e9a790fd002 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:36.713971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b3f01-c1ff-458e-9c86-fa2ed1aed45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:36.714728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b3f01-c1ff-458e-9c86-fa2ed1aed45b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:36.715078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b3f01-c1ff-458e-9c86-fa2ed1aed45b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:36.715421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b3f01-c1ff-458e-9c86-fa2ed1aed45b None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:36.717334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b3f01-c1ff-458e-9c86-fa2ed1aed45b None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:36.719479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b3f01-c1ff-458e-9c86-fa2ed1aed45b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:36.726969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 135/288] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:36 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:36.726969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b3f01-c1ff-458e-9c86-fa2ed1aed45b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:36.840773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d07c8-1c4e-4e47-9ace-9e9a790fd002 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:36.856570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:36.887534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0228f35-d0e7-44ed-b9c4-f9c1347f7b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:36.888413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228f35-d0e7-44ed-b9c4-f9c1347f7b06 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:36.888864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228f35-d0e7-44ed-b9c4-f9c1347f7b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:36.889755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228f35-d0e7-44ed-b9c4-f9c1347f7b06 None admin] PATH_INFO: `/v3/users/97eb68feeb2343eeb77eea1d61683cbc` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:36.891631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0228f35-d0e7-44ed-b9c4-f9c1347f7b06 None admin] RBAC: Authorizing `identity:get_user(user_id=97eb68feeb2343eeb77eea1d61683cbc)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:36.893563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0228f35-d0e7-44ed-b9c4-f9c1347f7b06 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:36.895602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 154/289] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:36 2022] GET /identity/v3/users/97eb68feeb2343eeb77eea1d61683cbc => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:36.896654 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0228f35-d0e7-44ed-b9c4-f9c1347f7b06 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:36.909645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b3f01-c1ff-458e-9c86-fa2ed1aed45b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:36.981560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:36.982490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:36.982777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:36.983056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:36.984558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] RBAC: Adding query filter params (role.id=bd70368fbbd7408eb37fc3ea32f7843e, user.id=57b17ce2bb0f4c2c8365fdf17592c69c, scope.system=all) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:36.984945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:36.986797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:37.004943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 136/290] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Oct 4 12:34:36 2022] GET /identity/v3/role_assignments?user.id=57b17ce2bb0f4c2c8365fdf17592c69c&scope.system=all&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:37.004943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:37.034795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:37.061303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0228f35-d0e7-44ed-b9c4-f9c1347f7b06 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:37.155017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab6568-5a09-4238-a838-d3020ea04c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:37.155969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab6568-5a09-4238-a838-d3020ea04c3e None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:37.158270 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab6568-5a09-4238-a838-d3020ea04c3e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:37.158794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab6568-5a09-4238-a838-d3020ea04c3e None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876/users/79abaa8e2d5c428c9b74d0fbca97b35e/roles/1bf206c740ba4f59b66a1cc010f7aee9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:37.163880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab6568-5a09-4238-a838-d3020ea04c3e None admin] RBAC: Authorizing `identity:create_grant(project_id=05e3776e5294421c871d6041b669b876, user_id=79abaa8e2d5c428c9b74d0fbca97b35e, role_id=1bf206c740ba4f59b66a1cc010f7aee9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:37.166937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab6568-5a09-4238-a838-d3020ea04c3e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:37.199715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 155/291] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:34:36 2022] PUT /identity/v3/projects/05e3776e5294421c871d6041b669b876/users/79abaa8e2d5c428c9b74d0fbca97b35e/roles/1bf206c740ba4f59b66a1cc010f7aee9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:37.204638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672eb2-ec6c-4531-9665-5ed5ba0ea1ed None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:37.250103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf0c11-d942-46cc-90a4-2c6b0b16c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:37.251005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf0c11-d942-46cc-90a4-2c6b0b16c6ad None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:37.251432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf0c11-d942-46cc-90a4-2c6b0b16c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:37.251849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf0c11-d942-46cc-90a4-2c6b0b16c6ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:37.343419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf0c11-d942-46cc-90a4-2c6b0b16c6ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:37.345411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf0c11-d942-46cc-90a4-2c6b0b16c6ad None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:37.375890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:37.499560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 137/292] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:37.511150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab6568-5a09-4238-a838-d3020ea04c3e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:37.605470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:37.761531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab6568-5a09-4238-a838-d3020ea04c3e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:37.859432 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97ee84-6cc1-4e25-84c2-6b4380fd79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:37.860528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ee84-6cc1-4e25-84c2-6b4380fd79f8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:37.861033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ee84-6cc1-4e25-84c2-6b4380fd79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:37.861526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97ee84-6cc1-4e25-84c2-6b4380fd79f8 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:37.866967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ee84-6cc1-4e25-84c2-6b4380fd79f8 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:37.869688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97ee84-6cc1-4e25-84c2-6b4380fd79f8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:37.873281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 156/293] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:37 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:37.882823 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf0c11-d942-46cc-90a4-2c6b0b16c6ad None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:38.138761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf0c11-d942-46cc-90a4-2c6b0b16c6ad None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:38.200827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:38.226243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5a248-0848-43e5-95ef-7aa9b9372672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:38.227281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a248-0848-43e5-95ef-7aa9b9372672 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:38.227779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a248-0848-43e5-95ef-7aa9b9372672 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:38.228271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a248-0848-43e5-95ef-7aa9b9372672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:38.229704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5a248-0848-43e5-95ef-7aa9b9372672 None admin] RBAC: Adding query filter params (role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=05e3776e5294421c871d6041b669b876, user.id=97eb68feeb2343eeb77eea1d61683cbc) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:38.230261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5a248-0848-43e5-95ef-7aa9b9372672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:38.233011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5a248-0848-43e5-95ef-7aa9b9372672 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:38.249675 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 138/294] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:37 2022] GET /identity/v3/role_assignments?user.id=97eb68feeb2343eeb77eea1d61683cbc&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 608 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:39.094241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c46de-a0e3-4966-b3ed-775f65f20adf None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:39.094948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c46de-a0e3-4966-b3ed-775f65f20adf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:39.095331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c46de-a0e3-4966-b3ed-775f65f20adf None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:39.098241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 157/295] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:39.107848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c9f32-e083-4114-8077-d5c06cb37288 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:39.108326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c9f32-e083-4114-8077-d5c06cb37288 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:39.108806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c9f32-e083-4114-8077-d5c06cb37288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:39.148211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-819c9f32-e083-4114-8077-d5c06cb37288 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:39.150235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-819c9f32-e083-4114-8077-d5c06cb37288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:39.262961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 139/296] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:39.659038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b3de-1bdf-4c4a-aebe-9e949c461f60 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:39.659526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b3de-1bdf-4c4a-aebe-9e949c461f60 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:39.659949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b3de-1bdf-4c4a-aebe-9e949c461f60 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:39.663216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 158/297] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:39.671723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a08b6-7de4-41e2-9bd1-fbc9b985c859 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:39.672093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a08b6-7de4-41e2-9bd1-fbc9b985c859 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:39.672561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a08b6-7de4-41e2-9bd1-fbc9b985c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:39.701656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8f8a08b6-7de4-41e2-9bd1-fbc9b985c859 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:39.703579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8f8a08b6-7de4-41e2-9bd1-fbc9b985c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:39.753139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6b3de-1bdf-4c4a-aebe-9e949c461f60 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:39.825645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 140/298] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:39.927583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6b3de-1bdf-4c4a-aebe-9e949c461f60 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:39.936412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:39.966986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f072-cab0-4333-a930-088cdd65738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:39.967996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f072-cab0-4333-a930-088cdd65738a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:39.968493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f072-cab0-4333-a930-088cdd65738a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:39.968954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f072-cab0-4333-a930-088cdd65738a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:39.970388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7f072-cab0-4333-a930-088cdd65738a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:39.972046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7f072-cab0-4333-a930-088cdd65738a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:39.974759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 159/299] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:39.980505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a08b6-7de4-41e2-9bd1-fbc9b985c859 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:40.034576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:40.092571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a08b6-7de4-41e2-9bd1-fbc9b985c859 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:40.153998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ecfbd-3ad6-426a-98a5-d9a73ac807f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:40.154885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ecfbd-3ad6-426a-98a5-d9a73ac807f6 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:40.157618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ecfbd-3ad6-426a-98a5-d9a73ac807f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:40.157618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ecfbd-3ad6-426a-98a5-d9a73ac807f6 None admin] PATH_INFO: `/v3/groups` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:40.157618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ecfbd-3ad6-426a-98a5-d9a73ac807f6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:40.159786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ecfbd-3ad6-426a-98a5-d9a73ac807f6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:40.182483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f072-cab0-4333-a930-088cdd65738a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:40.187912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 141/300] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Oct 4 12:34:39 2022] POST /identity/v3/groups => generated 229 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:34:40.342640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f072-cab0-4333-a930-088cdd65738a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:40.387379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8ef42-5ada-4b6e-a5df-fbf106d2c2ed None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:40.388059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8ef42-5ada-4b6e-a5df-fbf106d2c2ed None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:40.388533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8ef42-5ada-4b6e-a5df-fbf106d2c2ed None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:40.390268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 142/301] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:34:40.397121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5251f1-1561-4b8b-b587-ad0429a5f938 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:40.397814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5251f1-1561-4b8b-b587-ad0429a5f938 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:40.398317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5251f1-1561-4b8b-b587-ad0429a5f938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:40.408022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300064c-fdb5-4b9a-b384-10e5de7aa37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:40.408679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300064c-fdb5-4b9a-b384-10e5de7aa37e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:40.408959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300064c-fdb5-4b9a-b384-10e5de7aa37e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:40.409228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300064c-fdb5-4b9a-b384-10e5de7aa37e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300064c-fdb5-4b9a-b384-10e5de7aa37e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3300064c-fdb5-4b9a-b384-10e5de7aa37e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:40.428864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:40.430593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:40.432028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 160/302] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:40.435936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300064c-fdb5-4b9a-b384-10e5de7aa37e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:40.446647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8a5251f1-1561-4b8b-b587-ad0429a5f938 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:40.448713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8a5251f1-1561-4b8b-b587-ad0429a5f938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:40.488520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:40.562373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 143/303] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:40.621992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300064c-fdb5-4b9a-b384-10e5de7aa37e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:40.681078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec2a97-ab62-44f7-8299-e4c1c2a5361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:40.682091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2a97-ab62-44f7-8299-e4c1c2a5361b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:40.682595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2a97-ab62-44f7-8299-e4c1c2a5361b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:40.683059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec2a97-ab62-44f7-8299-e4c1c2a5361b None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:40.683949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2a97-ab62-44f7-8299-e4c1c2a5361b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:40.684458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2a97-ab62-44f7-8299-e4c1c2a5361b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:40.686158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec2a97-ab62-44f7-8299-e4c1c2a5361b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:40.696630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 161/304] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:40.702851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5251f1-1561-4b8b-b587-ad0429a5f938 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:40.744131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:40.754976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b327-e1ac-42fb-86c8-3e9553ba38e3 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:40.755634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b327-e1ac-42fb-86c8-3e9553ba38e3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:40.756101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b327-e1ac-42fb-86c8-3e9553ba38e3 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:40.758052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 162/305] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:40.770107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150381fc-018c-4d06-ae76-913ea5765f79 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:40.770744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150381fc-018c-4d06-ae76-913ea5765f79 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:40.771210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150381fc-018c-4d06-ae76-913ea5765f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:40.791082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-150381fc-018c-4d06-ae76-913ea5765f79 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:40.792834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-150381fc-018c-4d06-ae76-913ea5765f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:40.872698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 163/306] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:40.879716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5251f1-1561-4b8b-b587-ad0429a5f938 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:40.943837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65625a-c48f-4392-8015-d0feb4d7d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:40.944787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65625a-c48f-4392-8015-d0feb4d7d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:40.945261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65625a-c48f-4392-8015-d0feb4d7d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:40.945722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65625a-c48f-4392-8015-d0feb4d7d0e8 None admin] PATH_INFO: `/v3/users/7dc1a24612e64bf491b3ee5f4e79c58e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:40.970524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65625a-c48f-4392-8015-d0feb4d7d0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=7dc1a24612e64bf491b3ee5f4e79c58e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:40.973201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65625a-c48f-4392-8015-d0feb4d7d0e8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:40.976609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 144/307] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:40 2022] GET /identity/v3/users/7dc1a24612e64bf491b3ee5f4e79c58e => generated 293 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:40.983027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150381fc-018c-4d06-ae76-913ea5765f79 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:41.014055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:41.065891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65625a-c48f-4392-8015-d0feb4d7d0e8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:41.094035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150381fc-018c-4d06-ae76-913ea5765f79 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:41.134623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:41.135631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:41.136103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:41.136571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:41.137488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] RBAC: Adding query filter params (role.id=1bf206c740ba4f59b66a1cc010f7aee9, user.id=7dc1a24612e64bf491b3ee5f4e79c58e, scope.system=all) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:41.138024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:41.140245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:41.150283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 164/308] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Oct 4 12:34:40 2022] GET /identity/v3/role_assignments?user.id=7dc1a24612e64bf491b3ee5f4e79c58e&scope.system=all&role.id=1bf206c740ba4f59b66a1cc010f7aee9 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:41.242681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:41.256217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65625a-c48f-4392-8015-d0feb4d7d0e8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:41.283672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:41.309743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c758f-331e-4adf-9c23-02b642860616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:41.310786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c758f-331e-4adf-9c23-02b642860616 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:41.311371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c758f-331e-4adf-9c23-02b642860616 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:41.312018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c758f-331e-4adf-9c23-02b642860616 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:41.332748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c758f-331e-4adf-9c23-02b642860616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6f4c758f-331e-4adf-9c23-02b642860616 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:41.342478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:41.344423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:41.346276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:41.350976 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 145/309] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:41.360758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c758f-331e-4adf-9c23-02b642860616 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:41.459148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:41.473509 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ee2eb-56ec-4bd7-90be-c0aaab3362a5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:41.516521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06dfb-2400-4338-8668-36446f3ccdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:41.517390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06dfb-2400-4338-8668-36446f3ccdcf None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:41.517843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06dfb-2400-4338-8668-36446f3ccdcf None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:41.518248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06dfb-2400-4338-8668-36446f3ccdcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:41.530430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c758f-331e-4adf-9c23-02b642860616 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:41.532147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d06dfb-2400-4338-8668-36446f3ccdcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-74d06dfb-2400-4338-8668-36446f3ccdcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:41.539286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:41.540371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:41.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:41.543757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 165/310] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:41.551973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06dfb-2400-4338-8668-36446f3ccdcf None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:41.590152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:41.591108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:41.591534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:41.591948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:41.593751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:41.594432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:41.596546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:41.611205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 146/311] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:41.617380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:41.638214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:41.701551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06dfb-2400-4338-8668-36446f3ccdcf None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:41.748744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e47674-181d-4953-aaec-e8d863d65487 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:41.750995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:41.753068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:41.753663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:41.754210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:41.755150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:41.755665 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:41.758187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:41.775333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 166/312] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:41.783279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:41.800390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ebba-e45d-45cc-8be0-684402687f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:41.801453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ebba-e45d-45cc-8be0-684402687f0c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:41.801962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ebba-e45d-45cc-8be0-684402687f0c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:41.802488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ebba-e45d-45cc-8be0-684402687f0c None admin] PATH_INFO: `/v3/users/79abaa8e2d5c428c9b74d0fbca97b35e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:41.804024 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2ebba-e45d-45cc-8be0-684402687f0c None admin] RBAC: Authorizing `identity:get_user(user_id=79abaa8e2d5c428c9b74d0fbca97b35e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:41.805826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2ebba-e45d-45cc-8be0-684402687f0c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:41.807897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 147/313] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:41 2022] GET /identity/v3/users/79abaa8e2d5c428c9b74d0fbca97b35e => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:41.813297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:41.814660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ebba-e45d-45cc-8be0-684402687f0c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:41.943763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:41.977265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ebba-e45d-45cc-8be0-684402687f0c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:41.989005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdca99-8c96-429c-86dc-0369cc7c4a94 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:42.041912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50019b-a444-49c7-8702-92723d5a1ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:42.042837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50019b-a444-49c7-8702-92723d5a1ec7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:42.043287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50019b-a444-49c7-8702-92723d5a1ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:42.043739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50019b-a444-49c7-8702-92723d5a1ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:42.053454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c381e1-843f-41ba-a559-131d13167129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:42.054514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c381e1-843f-41ba-a559-131d13167129 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:42.054964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c381e1-843f-41ba-a559-131d13167129 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:42.055499 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c381e1-843f-41ba-a559-131d13167129 None admin] PATH_INFO: `/v3/users/57b17ce2bb0f4c2c8365fdf17592c69c` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:42.057496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c381e1-843f-41ba-a559-131d13167129 None admin] RBAC: Authorizing `identity:get_user(user_id=57b17ce2bb0f4c2c8365fdf17592c69c)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:42.060309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c381e1-843f-41ba-a559-131d13167129 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:42.063864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 167/314] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:41 2022] GET /identity/v3/users/57b17ce2bb0f4c2c8365fdf17592c69c => generated 293 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:42.070748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c381e1-843f-41ba-a559-131d13167129 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:42.181864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50019b-a444-49c7-8702-92723d5a1ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:42.184811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50019b-a444-49c7-8702-92723d5a1ec7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:42.189563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:42.201907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c381e1-843f-41ba-a559-131d13167129 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:42.246659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8098-2945-4ba7-9739-407ad0fbb6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:42.247882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8098-2945-4ba7-9739-407ad0fbb6da None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:42.248367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8098-2945-4ba7-9739-407ad0fbb6da None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:42.248853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8098-2945-4ba7-9739-407ad0fbb6da None admin] PATH_INFO: `/v3/system/users/57b17ce2bb0f4c2c8365fdf17592c69c/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:42.250857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8098-2945-4ba7-9739-407ad0fbb6da None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=57b17ce2bb0f4c2c8365fdf17592c69c, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:42.252824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8098-2945-4ba7-9739-407ad0fbb6da None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:42.271761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 168/315] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Oct 4 12:34:42 2022] PUT /identity/v3/system/users/57b17ce2bb0f4c2c8365fdf17592c69c/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:42.370128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:42.405315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 148/316] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:42.411143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8098-2945-4ba7-9739-407ad0fbb6da None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:42.570635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8098-2945-4ba7-9739-407ad0fbb6da None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:42.636915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa403534-0da7-45a3-b1a4-950ab40da6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:42.638014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403534-0da7-45a3-b1a4-950ab40da6af None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:42.638508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403534-0da7-45a3-b1a4-950ab40da6af None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:42.638998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403534-0da7-45a3-b1a4-950ab40da6af None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:42.641048 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa403534-0da7-45a3-b1a4-950ab40da6af None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:42.643868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa403534-0da7-45a3-b1a4-950ab40da6af None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:42.647495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 169/317] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:42 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:42.654140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50019b-a444-49c7-8702-92723d5a1ec7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:42.782756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50019b-a444-49c7-8702-92723d5a1ec7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:42.849039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae932498-8edb-451f-8788-1da73de8d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:42.850096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932498-8edb-451f-8788-1da73de8d555 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:42.850585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932498-8edb-451f-8788-1da73de8d555 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:42.851064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932498-8edb-451f-8788-1da73de8d555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:42.852408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae932498-8edb-451f-8788-1da73de8d555 None admin] RBAC: Adding query filter params (role.id=1bf206c740ba4f59b66a1cc010f7aee9, scope.project.id=05e3776e5294421c871d6041b669b876, user.id=79abaa8e2d5c428c9b74d0fbca97b35e) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:42.852957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae932498-8edb-451f-8788-1da73de8d555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:42.856013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae932498-8edb-451f-8788-1da73de8d555 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:42.869268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 149/318] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:34:42 2022] GET /identity/v3/role_assignments?user.id=79abaa8e2d5c428c9b74d0fbca97b35e&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=1bf206c740ba4f59b66a1cc010f7aee9 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:43.345750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636060a0-9bac-446a-af1f-b42019014dfc None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:43.346268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636060a0-9bac-446a-af1f-b42019014dfc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:43.346651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636060a0-9bac-446a-af1f-b42019014dfc None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:43.349029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 170/319] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:43.355620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144faa4d-8be5-4611-a372-1f456ad9d1cf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:43.356064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144faa4d-8be5-4611-a372-1f456ad9d1cf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:43.356471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144faa4d-8be5-4611-a372-1f456ad9d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:43.382448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-144faa4d-8be5-4611-a372-1f456ad9d1cf None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:43.384621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-144faa4d-8be5-4611-a372-1f456ad9d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:43.452175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:43.496948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 150/320] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:43.766725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636060a0-9bac-446a-af1f-b42019014dfc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:43.783478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:43.895140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636060a0-9bac-446a-af1f-b42019014dfc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:43.933789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa0b75-2bdd-422b-b297-9ece9e65389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:43.934441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0b75-2bdd-422b-b297-9ece9e65389a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:43.934721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0b75-2bdd-422b-b297-9ece9e65389a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:43.934995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0b75-2bdd-422b-b297-9ece9e65389a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:43.936155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa0b75-2bdd-422b-b297-9ece9e65389a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:43.937644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa0b75-2bdd-422b-b297-9ece9e65389a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:43.939532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 171/321] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:43.945621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144faa4d-8be5-4611-a372-1f456ad9d1cf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:44.085679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144faa4d-8be5-4611-a372-1f456ad9d1cf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:44.124396 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c698a-d947-4afd-9315-641079e5e4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:44.125040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c698a-d947-4afd-9315-641079e5e4d8 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:44.125324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c698a-d947-4afd-9315-641079e5e4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:44.125641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c698a-d947-4afd-9315-641079e5e4d8 None admin] PATH_INFO: `/v3/groups` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:44.126290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c698a-d947-4afd-9315-641079e5e4d8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:44.127844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c698a-d947-4afd-9315-641079e5e4d8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:44.148093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 151/322] 10.222.0.30 () {60 vars in 1134 bytes} [Tue Oct 4 12:34:43 2022] POST /identity/v3/groups => generated 226 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:34:44.256720 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75405-85c2-483c-9249-dfe257a34ce0 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:44.256997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75405-85c2-483c-9249-dfe257a34ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:44.257269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75405-85c2-483c-9249-dfe257a34ce0 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:44.258717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 172/323] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:34:44.264663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7a3a-d9a6-47bb-a5e6-3c3022e3a772 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:44.264952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7a3a-d9a6-47bb-a5e6-3c3022e3a772 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:44.265231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7a3a-d9a6-47bb-a5e6-3c3022e3a772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:44.287167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-390d7a3a-d9a6-47bb-a5e6-3c3022e3a772 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:44.288415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-390d7a3a-d9a6-47bb-a5e6-3c3022e3a772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:44.326717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:44.375779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 152/324] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:44.653587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a75405-85c2-483c-9249-dfe257a34ce0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:44.756107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:44.798858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a75405-85c2-483c-9249-dfe257a34ce0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:44.842902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea660-d565-4469-86e0-f76e294a677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:44.843570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea660-d565-4469-86e0-f76e294a677b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:44.843849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea660-d565-4469-86e0-f76e294a677b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:44.844123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea660-d565-4469-86e0-f76e294a677b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:44.858506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ea660-d565-4469-86e0-f76e294a677b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7b2ea660-d565-4469-86e0-f76e294a677b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:44.863852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:44.865542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:44.868565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 173/325] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:44.877629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7a3a-d9a6-47bb-a5e6-3c3022e3a772 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:44.913838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f0865-dbd7-444c-bf17-fd5104097dbf None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:44.914222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f0865-dbd7-444c-bf17-fd5104097dbf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:44.914450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f0865-dbd7-444c-bf17-fd5104097dbf None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:44.916030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 174/326] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:34:44.923197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375a24-ef38-4f78-94de-ce462c54e2ee None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:44.923569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375a24-ef38-4f78-94de-ce462c54e2ee None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:44.923802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375a24-ef38-4f78-94de-ce462c54e2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:44.946343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ac375a24-ef38-4f78-94de-ce462c54e2ee None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:44.947569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ac375a24-ef38-4f78-94de-ce462c54e2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:45.067561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 175/327] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:45.068043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7a3a-d9a6-47bb-a5e6-3c3022e3a772 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:45.128605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:45.130224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:45.130684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:45.131137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:45.132211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:45.132707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:45.135102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:45.153297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 153/328] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:45.159186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac375a24-ef38-4f78-94de-ce462c54e2ee None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:45.247674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:45.286199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac375a24-ef38-4f78-94de-ce462c54e2ee None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:45.326277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0426f-ac46-4d0a-b090-11d692a7e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:45.326922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0426f-ac46-4d0a-b090-11d692a7e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:45.327200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0426f-ac46-4d0a-b090-11d692a7e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:45.327470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0426f-ac46-4d0a-b090-11d692a7e4b0 None admin] PATH_INFO: `/v3/users/7dc1a24612e64bf491b3ee5f4e79c58e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:45.328639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0426f-ac46-4d0a-b090-11d692a7e4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=7dc1a24612e64bf491b3ee5f4e79c58e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:45.330175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0426f-ac46-4d0a-b090-11d692a7e4b0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:45.332226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 176/329] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:45 2022] GET /identity/v3/users/7dc1a24612e64bf491b3ee5f4e79c58e => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:45.338002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:45.380559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:45.484147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7989cf-2f48-4ccb-bd62-0dd63c662035 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:45.502770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0426f-ac46-4d0a-b090-11d692a7e4b0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:45.527202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b49cb-3812-48c2-86a5-254dbe82367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:45.527870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b49cb-3812-48c2-86a5-254dbe82367a None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:45.528410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b49cb-3812-48c2-86a5-254dbe82367a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:45.528692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b49cb-3812-48c2-86a5-254dbe82367a None admin] PATH_INFO: `/v3/system/users/7dc1a24612e64bf491b3ee5f4e79c58e/roles/1bf206c740ba4f59b66a1cc010f7aee9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:45.530182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b49cb-3812-48c2-86a5-254dbe82367a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7dc1a24612e64bf491b3ee5f4e79c58e, role_id=1bf206c740ba4f59b66a1cc010f7aee9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:45.531590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b49cb-3812-48c2-86a5-254dbe82367a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:45.553013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 154/330] 10.222.0.30 () {58 vars in 1334 bytes} [Tue Oct 4 12:34:45 2022] PUT /identity/v3/system/users/7dc1a24612e64bf491b3ee5f4e79c58e/roles/1bf206c740ba4f59b66a1cc010f7aee9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:34:45.637303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0426f-ac46-4d0a-b090-11d692a7e4b0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:45.686723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1a70-24af-4db8-8305-aeb9da633655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:45.687829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1a70-24af-4db8-8305-aeb9da633655 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:45.688313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1a70-24af-4db8-8305-aeb9da633655 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:45.688780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1a70-24af-4db8-8305-aeb9da633655 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:45.700197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:45.705890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f1a70-24af-4db8-8305-aeb9da633655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-503f1a70-24af-4db8-8305-aeb9da633655 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:45.713660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:45.714670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:45.715464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:45.718479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 177/331] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:34:45.726763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b49cb-3812-48c2-86a5-254dbe82367a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:45.872736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:45.881673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b49cb-3812-48c2-86a5-254dbe82367a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:45.923775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:45.924401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:45.924680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:45.924952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:45.925677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:45.925989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:45.927507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:45.939681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 155/332] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:45.946477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1a70-24af-4db8-8305-aeb9da633655 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:46.084091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1a70-24af-4db8-8305-aeb9da633655 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:46.127227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504178ac-e082-49d6-ace5-8793f9a118b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:46.127823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504178ac-e082-49d6-ace5-8793f9a118b2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:46.128108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504178ac-e082-49d6-ace5-8793f9a118b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:46.128387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504178ac-e082-49d6-ace5-8793f9a118b2 None admin] PATH_INFO: `/v3/users/57b17ce2bb0f4c2c8365fdf17592c69c` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:46.130413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504178ac-e082-49d6-ace5-8793f9a118b2 None admin] RBAC: Authorizing `identity:get_user(user_id=57b17ce2bb0f4c2c8365fdf17592c69c)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:46.131971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504178ac-e082-49d6-ace5-8793f9a118b2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:46.133762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 178/333] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:45 2022] GET /identity/v3/users/57b17ce2bb0f4c2c8365fdf17592c69c => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:46.140213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:46.272291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919f281-80a3-4f89-a85d-18c2ef5b6682 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:46.310647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194e64e-8f03-4bc6-bfad-5661361be964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:46.311327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e64e-8f03-4bc6-bfad-5661361be964 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:46.311614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e64e-8f03-4bc6-bfad-5661361be964 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:46.311886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e64e-8f03-4bc6-bfad-5661361be964 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:46.312628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194e64e-8f03-4bc6-bfad-5661361be964 None admin] RBAC: Adding query filter params (role.id=bd70368fbbd7408eb37fc3ea32f7843e, user.id=57b17ce2bb0f4c2c8365fdf17592c69c, scope.system=all) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:46.312933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194e64e-8f03-4bc6-bfad-5661361be964 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:46.314422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194e64e-8f03-4bc6-bfad-5661361be964 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:46.334700 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 156/334] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Oct 4 12:34:46 2022] GET /identity/v3/role_assignments?user.id=57b17ce2bb0f4c2c8365fdf17592c69c&scope.system=all&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:47.264087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896548-efa4-4e29-bc58-4bcfa917a925 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:47.265185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896548-efa4-4e29-bc58-4bcfa917a925 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:47.265753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae896548-efa4-4e29-bc58-4bcfa917a925 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:47.267751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 179/335] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:47.275343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ce41-7382-4484-8709-20684a694d50 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:47.276326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ce41-7382-4484-8709-20684a694d50 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:47.276872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908ce41-7382-4484-8709-20684a694d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:47.303432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0908ce41-7382-4484-8709-20684a694d50 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:47.305040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0908ce41-7382-4484-8709-20684a694d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:47.322124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:47.413992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 157/336] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:47.931876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568faaa8-2081-4386-a33b-d4612d817cdc None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:47.932595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568faaa8-2081-4386-a33b-d4612d817cdc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:47.933082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568faaa8-2081-4386-a33b-d4612d817cdc None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:47.934945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 180/337] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:47.945125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5641f2-d115-44cf-becc-58b0c4ea151d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:47.948374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5641f2-d115-44cf-becc-58b0c4ea151d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:47.948374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5641f2-d115-44cf-becc-58b0c4ea151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:47.971471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cd5641f2-d115-44cf-becc-58b0c4ea151d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:47.973224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cd5641f2-d115-44cf-becc-58b0c4ea151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:48.020547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568faaa8-2081-4386-a33b-d4612d817cdc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:48.071806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 158/338] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:48.154298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:48.204091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568faaa8-2081-4386-a33b-d4612d817cdc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:48.258385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09aeb-3343-41ab-9c7a-3f29f773144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:48.259046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09aeb-3343-41ab-9c7a-3f29f773144d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:48.259334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09aeb-3343-41ab-9c7a-3f29f773144d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:48.259611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09aeb-3343-41ab-9c7a-3f29f773144d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:48.276226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e09aeb-3343-41ab-9c7a-3f29f773144d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-15e09aeb-3343-41ab-9c7a-3f29f773144d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:48.281507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:48.282442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:48.283204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 181/339] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:48.292994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5641f2-d115-44cf-becc-58b0c4ea151d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:48.362332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e58e9-d272-4487-b797-1d12cee5eab5 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:48.362667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e58e9-d272-4487-b797-1d12cee5eab5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:48.362899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e58e9-d272-4487-b797-1d12cee5eab5 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:48.364729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 182/340] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:48.370462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c5f4-fc4d-4776-8bdd-25d97e3d4d31 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:48.370781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c5f4-fc4d-4776-8bdd-25d97e3d4d31 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:48.371021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c5f4-fc4d-4776-8bdd-25d97e3d4d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:48.402173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b135c5f4-fc4d-4776-8bdd-25d97e3d4d31 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:48.403692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b135c5f4-fc4d-4776-8bdd-25d97e3d4d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:48.542136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:48.587899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 183/341] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:48.633124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5641f2-d115-44cf-becc-58b0c4ea151d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:48.736603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:48.737689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:48.738715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:48.739167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:48.740405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:48.740939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:48.743655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:48.763370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 159/342] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:48.772373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135c5f4-fc4d-4776-8bdd-25d97e3d4d31 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:48.821231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:48.886552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:48.992053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135c5f4-fc4d-4776-8bdd-25d97e3d4d31 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:49.064511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914680f-baeb-412d-a17a-665a376aacd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:49.065538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914680f-baeb-412d-a17a-665a376aacd7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.066012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914680f-baeb-412d-a17a-665a376aacd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.066533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914680f-baeb-412d-a17a-665a376aacd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:49.069306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ae3de-b719-44cf-afde-b3ba371e3ad9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:49.136112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24483-511e-4728-8142-4ff01fb99c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:49.136880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24483-511e-4728-8142-4ff01fb99c99 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.137169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24483-511e-4728-8142-4ff01fb99c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.137543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d24483-511e-4728-8142-4ff01fb99c99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:49.145147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914680f-baeb-412d-a17a-665a376aacd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:49.146895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:49.147797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914680f-baeb-412d-a17a-665a376aacd7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:49.159699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d24483-511e-4728-8142-4ff01fb99c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-64d24483-511e-4728-8142-4ff01fb99c99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:49.165819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:49.166774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:49.167546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:49.172367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 160/343] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:49.173539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24483-511e-4728-8142-4ff01fb99c99 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:49.240157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:49.355626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 184/344] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:49.356503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914680f-baeb-412d-a17a-665a376aacd7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:49.386468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d24483-511e-4728-8142-4ff01fb99c99 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:49.504643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3069-863b-418d-a9d0-47b9d57db37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:49.506136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3069-863b-418d-a9d0-47b9d57db37e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.506817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3069-863b-418d-a9d0-47b9d57db37e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.507662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3069-863b-418d-a9d0-47b9d57db37e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:49.523249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de3069-863b-418d-a9d0-47b9d57db37e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e3de3069-863b-418d-a9d0-47b9d57db37e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:49.531138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:49.532106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:49.532988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:49.535526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 161/345] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:49.537342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3069-863b-418d-a9d0-47b9d57db37e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:49.539719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914680f-baeb-412d-a17a-665a376aacd7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:49.617573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cbd91-131d-4c09-b2e8-c04988561999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:49.618158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:49.618887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbd91-131d-4c09-b2e8-c04988561999 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.619399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbd91-131d-4c09-b2e8-c04988561999 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.619881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cbd91-131d-4c09-b2e8-c04988561999 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:49.620919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cbd91-131d-4c09-b2e8-c04988561999 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:49.621481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cbd91-131d-4c09-b2e8-c04988561999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:49.623570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295cbd91-131d-4c09-b2e8-c04988561999 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:49.636840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 185/346] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:49.638928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce50bd-19c7-4f84-89bf-426dbb65b896 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.639495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce50bd-19c7-4f84-89bf-426dbb65b896 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.640626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce50bd-19c7-4f84-89bf-426dbb65b896 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:49.642564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 186/347] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:49.643643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce50bd-19c7-4f84-89bf-426dbb65b896 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:49.668148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:49.697564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3069-863b-418d-a9d0-47b9d57db37e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:49.737794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf96df-cb88-4701-9b15-3749736eca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:49.739498 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf96df-cb88-4701-9b15-3749736eca50 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.740093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf96df-cb88-4701-9b15-3749736eca50 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.740573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf96df-cb88-4701-9b15-3749736eca50 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:49.742091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf96df-cb88-4701-9b15-3749736eca50 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:49.744150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf96df-cb88-4701-9b15-3749736eca50 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:49.746577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 162/348] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:49 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:49.747799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf96df-cb88-4701-9b15-3749736eca50 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:49.793236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce50bd-19c7-4f84-89bf-426dbb65b896 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:49.835737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac11e8-74a3-4fd7-a2ac-02bf0839e772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:49.836670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac11e8-74a3-4fd7-a2ac-02bf0839e772 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.837651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac11e8-74a3-4fd7-a2ac-02bf0839e772 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.837651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac11e8-74a3-4fd7-a2ac-02bf0839e772 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:49.838649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac11e8-74a3-4fd7-a2ac-02bf0839e772 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:49.839192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac11e8-74a3-4fd7-a2ac-02bf0839e772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:49.841888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac11e8-74a3-4fd7-a2ac-02bf0839e772 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:49.861201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 187/349] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:49.863415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bae4-8b8b-4389-8126-aaeabd059516 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.863871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bae4-8b8b-4389-8126-aaeabd059516 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.864291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3bae4-8b8b-4389-8126-aaeabd059516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:49.883661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf96df-cb88-4701-9b15-3749736eca50 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:49.896390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e7c3bae4-8b8b-4389-8126-aaeabd059516 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:49.898396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e7c3bae4-8b8b-4389-8126-aaeabd059516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:49.914350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:49.926771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5dbea-a720-40b2-a2de-39b5d8e3ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:49.927230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5dbea-a720-40b2-a2de-39b5d8e3ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:49.927565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5dbea-a720-40b2-a2de-39b5d8e3ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:49.928134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5dbea-a720-40b2-a2de-39b5d8e3ffa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:50.017322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5dbea-a720-40b2-a2de-39b5d8e3ffa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:50.019113 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5dbea-a720-40b2-a2de-39b5d8e3ffa7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:50.036779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 188/350] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:50.038329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3bae4-8b8b-4389-8126-aaeabd059516 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:50.058725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:50.210481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 163/351] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:50.211780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5dbea-a720-40b2-a2de-39b5d8e3ffa7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:50.242041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:50.245792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3bae4-8b8b-4389-8126-aaeabd059516 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:50.321396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663321e-5f79-401b-a175-33ab1cc9573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:50.322703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663321e-5f79-401b-a175-33ab1cc9573e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:50.323427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663321e-5f79-401b-a175-33ab1cc9573e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:50.324102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663321e-5f79-401b-a175-33ab1cc9573e None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:50.336769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663321e-5f79-401b-a175-33ab1cc9573e None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:50.340595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663321e-5f79-401b-a175-33ab1cc9573e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:50.342394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5dbea-a720-40b2-a2de-39b5d8e3ffa7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:50.344020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 189/352] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:50 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:50.350460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6db5d-8e91-48d4-a74e-d7995d5996f9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:50.351095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6db5d-8e91-48d4-a74e-d7995d5996f9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:50.352250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6db5d-8e91-48d4-a74e-d7995d5996f9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:50.355487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 190/353] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:50.356228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6db5d-8e91-48d4-a74e-d7995d5996f9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:50.391677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940025f-998c-482a-a462-397d67b33aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:50.392396 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940025f-998c-482a-a462-397d67b33aad None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:50.392613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940025f-998c-482a-a462-397d67b33aad None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:50.392864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940025f-998c-482a-a462-397d67b33aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:50.489836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:50.507554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940025f-998c-482a-a462-397d67b33aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:50.509300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940025f-998c-482a-a462-397d67b33aad None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:50.537998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6db5d-8e91-48d4-a74e-d7995d5996f9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:50.548003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:50.594831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6133e-817f-45a4-aac8-be84aa14a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:50.595502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6133e-817f-45a4-aac8-be84aa14a61e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:50.595786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6133e-817f-45a4-aac8-be84aa14a61e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:50.596064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6133e-817f-45a4-aac8-be84aa14a61e None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:50.598327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6133e-817f-45a4-aac8-be84aa14a61e None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:50.599859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6133e-817f-45a4-aac8-be84aa14a61e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:50.601971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 191/354] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:50 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:50.602804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6133e-817f-45a4-aac8-be84aa14a61e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:50.681242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 164/355] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:50.684860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6b66-3742-44f0-90b9-381bef71b190 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:50.685538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6b66-3742-44f0-90b9-381bef71b190 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:50.686283 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6b66-3742-44f0-90b9-381bef71b190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:50.715111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a75c6b66-3742-44f0-90b9-381bef71b190 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:50.716820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a75c6b66-3742-44f0-90b9-381bef71b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:50.776656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6133e-817f-45a4-aac8-be84aa14a61e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:50.828728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 165/356] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:50.833625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c6b66-3742-44f0-90b9-381bef71b190 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:50.839115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:50.840092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:50.840551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:50.841006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:50.842300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] RBAC: Adding query filter params (group.id=a5d164dec3bb46b7a4cabd5229a53c93, role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:50.842815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:50.844729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:50.853272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 192/357] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:34:50 2022] GET /identity/v3/role_assignments?group.id=a5d164dec3bb46b7a4cabd5229a53c93&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=0adab6046ed34edf8914c4971198655f => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:50.855692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:50.873327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:50.944408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:51.041056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c6b66-3742-44f0-90b9-381bef71b190 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:51.076046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571095d6-a281-486f-a7e6-84d89b300e6d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:51.111179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65221f1-b958-4c32-ba1c-262b9479fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:51.112858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65221f1-b958-4c32-ba1c-262b9479fa32 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:51.113717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65221f1-b958-4c32-ba1c-262b9479fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:51.114426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65221f1-b958-4c32-ba1c-262b9479fa32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:51.135380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65221f1-b958-4c32-ba1c-262b9479fa32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d65221f1-b958-4c32-ba1c-262b9479fa32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:51.146632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:51.148177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:51.149678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:51.150825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768825de-c922-4294-ac68-79007348fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:51.150825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768825de-c922-4294-ac68-79007348fa3b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:51.151062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768825de-c922-4294-ac68-79007348fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:51.152002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768825de-c922-4294-ac68-79007348fa3b None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:51.153545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 166/358] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:51.153827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768825de-c922-4294-ac68-79007348fa3b None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:51.154292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65221f1-b958-4c32-ba1c-262b9479fa32 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:51.156541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768825de-c922-4294-ac68-79007348fa3b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:51.161749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 193/359] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:50 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:51.164349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3edb4-0ae1-4b80-bae5-01b85599c6b8 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:51.164693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3edb4-0ae1-4b80-bae5-01b85599c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:51.165067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3edb4-0ae1-4b80-bae5-01b85599c6b8 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:51.168425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 194/360] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:51.169219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3edb4-0ae1-4b80-bae5-01b85599c6b8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:51.310449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65221f1-b958-4c32-ba1c-262b9479fa32 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:51.312260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:51.337720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:51.358850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3edb4-0ae1-4b80-bae5-01b85599c6b8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:51.372983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cd2c1-62c7-4198-b1da-d68ffd6e3be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:51.373748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cd2c1-62c7-4198-b1da-d68ffd6e3be9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:51.374032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cd2c1-62c7-4198-b1da-d68ffd6e3be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:51.374311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cd2c1-62c7-4198-b1da-d68ffd6e3be9 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:51.376060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cd2c1-62c7-4198-b1da-d68ffd6e3be9 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:51.378009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cd2c1-62c7-4198-b1da-d68ffd6e3be9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:51.379833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 167/361] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:51 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:51.380997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cd2c1-62c7-4198-b1da-d68ffd6e3be9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:51.439623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da93d-56f5-4295-a502-3212ed465cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:51.440670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da93d-56f5-4295-a502-3212ed465cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:51.441155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da93d-56f5-4295-a502-3212ed465cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:51.441651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da93d-56f5-4295-a502-3212ed465cf3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:51.470167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3da93d-56f5-4295-a502-3212ed465cf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-2b3da93d-56f5-4295-a502-3212ed465cf3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:51.480691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:51.482512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 195/362] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:51.487078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da93d-56f5-4295-a502-3212ed465cf3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:51.592836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cd2c1-62c7-4198-b1da-d68ffd6e3be9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:51.656570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05af8b-0559-4be8-ab19-4d3ca4a2544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:51.657194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05af8b-0559-4be8-ab19-4d3ca4a2544e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:51.657482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05af8b-0559-4be8-ab19-4d3ca4a2544e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:51.657790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05af8b-0559-4be8-ab19-4d3ca4a2544e None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:51.658465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05af8b-0559-4be8-ab19-4d3ca4a2544e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:51.658770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05af8b-0559-4be8-ab19-4d3ca4a2544e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:51.660237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05af8b-0559-4be8-ab19-4d3ca4a2544e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:51.672500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 168/363] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:51.674793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211e5cd-3217-4c57-a30d-929f8e3a103a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:51.675263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211e5cd-3217-4c57-a30d-929f8e3a103a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:51.675800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211e5cd-3217-4c57-a30d-929f8e3a103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:51.701671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b211e5cd-3217-4c57-a30d-929f8e3a103a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:51.702334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b211e5cd-3217-4c57-a30d-929f8e3a103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:51.705646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da93d-56f5-4295-a502-3212ed465cf3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:51.775799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:51.776729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:51.778524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:51.779393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:51.779393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:51.780331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] RBAC: Adding query filter params (group.id=a5d164dec3bb46b7a4cabd5229a53c93, role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:51.780656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:51.782642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:51.790546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 196/364] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:34:51 2022] GET /identity/v3/role_assignments?group.id=a5d164dec3bb46b7a4cabd5229a53c93&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 260 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:51.791353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:51.796218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:51.837560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 169/365] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:51.839191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211e5cd-3217-4c57-a30d-929f8e3a103a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:51.999599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752a69-3f41-4413-b15d-4f7a9d2b1559 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:52.067172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f3dc7-4dd2-4fdd-a971-012ef9f4fc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:52.074379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3dc7-4dd2-4fdd-a971-012ef9f4fc8b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:52.074379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3dc7-4dd2-4fdd-a971-012ef9f4fc8b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:52.074379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f3dc7-4dd2-4fdd-a971-012ef9f4fc8b None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:52.074379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f3dc7-4dd2-4fdd-a971-012ef9f4fc8b None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:52.074379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f3dc7-4dd2-4fdd-a971-012ef9f4fc8b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:52.078006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 197/366] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:51 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:52.079069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f3dc7-4dd2-4fdd-a971-012ef9f4fc8b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:52.177401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:52.218458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211e5cd-3217-4c57-a30d-929f8e3a103a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:52.226323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f3dc7-4dd2-4fdd-a971-012ef9f4fc8b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:52.268063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e0ff3-99f9-43bd-91c4-2f45031d4b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:52.268664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e0ff3-99f9-43bd-91c4-2f45031d4b99 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:52.268965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e0ff3-99f9-43bd-91c4-2f45031d4b99 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:52.269250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e0ff3-99f9-43bd-91c4-2f45031d4b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:52.295649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:52.296630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:52.297142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:52.297576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:52.299009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:52.299488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:52.302605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:52.330872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 170/367] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:52.332283 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:52.350380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e0ff3-99f9-43bd-91c4-2f45031d4b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:52.351891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e0ff3-99f9-43bd-91c4-2f45031d4b99 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:52.425040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:52.434033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:52.475196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 198/368] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:34:52.476591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e0ff3-99f9-43bd-91c4-2f45031d4b99 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:52.559391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d805c5-b676-4053-ac9c-5f2449d3f520 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:52.595172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e0ff3-99f9-43bd-91c4-2f45031d4b99 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:52.623566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:52.624219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:52.624471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:52.625161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:52.625620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] RBAC: Adding query filter params (group.id=a5d164dec3bb46b7a4cabd5229a53c93, role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=05e3776e5294421c871d6041b669b876) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:52.625948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:52.627452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:52.634302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 171/369] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:34:52 2022] GET /identity/v3/role_assignments?group.id=a5d164dec3bb46b7a4cabd5229a53c93&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:52.635014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:52.646348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ae3f-1d07-4e24-bd09-6c392ce70cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:52.647348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ae3f-1d07-4e24-bd09-6c392ce70cc7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:52.647826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ae3f-1d07-4e24-bd09-6c392ce70cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:52.648293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639ae3f-1d07-4e24-bd09-6c392ce70cc7 None admin] PATH_INFO: `/v3/users/7dc1a24612e64bf491b3ee5f4e79c58e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:52.653067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639ae3f-1d07-4e24-bd09-6c392ce70cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=7dc1a24612e64bf491b3ee5f4e79c58e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:52.655065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639ae3f-1d07-4e24-bd09-6c392ce70cc7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:52.657214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 199/370] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:34:52 2022] GET /identity/v3/users/7dc1a24612e64bf491b3ee5f4e79c58e => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:52.667093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ae3f-1d07-4e24-bd09-6c392ce70cc7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:52.726574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:52.866226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:52.872747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1077b6-660d-496a-9b56-4f6e2a9ff3e0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:52.906971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639ae3f-1d07-4e24-bd09-6c392ce70cc7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:52.953132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6cf1-9c83-4f12-8ede-20c5d418fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:52.954332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6cf1-9c83-4f12-8ede-20c5d418fce3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:52.955063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6cf1-9c83-4f12-8ede-20c5d418fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:52.956075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6cf1-9c83-4f12-8ede-20c5d418fce3 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:52.958404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f6cf1-9c83-4f12-8ede-20c5d418fce3 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:52.961278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f6cf1-9c83-4f12-8ede-20c5d418fce3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:52.964577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 172/371] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:52 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:52.965831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6cf1-9c83-4f12-8ede-20c5d418fce3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:52.977655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:52.978290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:52.978580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:52.978857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:52.979614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] RBAC: Adding query filter params (role.id=1bf206c740ba4f59b66a1cc010f7aee9, user.id=7dc1a24612e64bf491b3ee5f4e79c58e, scope.system=all) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:52.979991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:52.982227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:53.003550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 200/372] 10.222.0.30 () {56 vars in 1308 bytes} [Tue Oct 4 12:34:52 2022] GET /identity/v3/role_assignments?user.id=7dc1a24612e64bf491b3ee5f4e79c58e&scope.system=all&role.id=1bf206c740ba4f59b66a1cc010f7aee9 => generated 510 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:53.005154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:53.122555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6cf1-9c83-4f12-8ede-20c5d418fce3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:53.140088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:53.156026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74fd8a-0386-4544-b736-0d14a3081db5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:53.167154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd567b-3833-4768-be74-99a240135fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:53.167807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd567b-3833-4768-be74-99a240135fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:53.168092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd567b-3833-4768-be74-99a240135fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:53.168717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd567b-3833-4768-be74-99a240135fa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:53.181502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd567b-3833-4768-be74-99a240135fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-55dd567b-3833-4768-be74-99a240135fa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:53.188095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:53.189061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:53.189898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 173/373] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:34:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:53.204583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd567b-3833-4768-be74-99a240135fa9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:53.215468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fd53a-0de5-4045-a93d-4d7e945fbb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:53.216134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd53a-0de5-4045-a93d-4d7e945fbb2b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:53.216413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd53a-0de5-4045-a93d-4d7e945fbb2b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:53.216688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fd53a-0de5-4045-a93d-4d7e945fbb2b None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:53.217947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fd53a-0de5-4045-a93d-4d7e945fbb2b None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:53.219479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fd53a-0de5-4045-a93d-4d7e945fbb2b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:53.221395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 201/374] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:53 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:53.243918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fd53a-0de5-4045-a93d-4d7e945fbb2b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:53.245191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:53.333760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd567b-3833-4768-be74-99a240135fa9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:53.373938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:53.374489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:53.374771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:53.375051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:53.375751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:53.376071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:53.377644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:53.388446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 174/375] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:53.395558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:53.499751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fd53a-0de5-4045-a93d-4d7e945fbb2b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:53.580715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:53.581452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:53.582457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:53.582744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:53.583512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] RBAC: Adding query filter params (group.id=a5d164dec3bb46b7a4cabd5229a53c93, role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=05e3776e5294421c871d6041b669b876) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:53.583825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:53.585314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:53.592711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 202/376] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:34:53 2022] GET /identity/v3/role_assignments?group.id=a5d164dec3bb46b7a4cabd5229a53c93&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=0adab6046ed34edf8914c4971198655f => generated 260 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:53.606138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:53.621860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da924954-721c-4a9c-8527-2a9617a874c5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:53.678405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb416d-3b95-43de-8eb3-685b8ac64921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:53.679038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb416d-3b95-43de-8eb3-685b8ac64921 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:53.679268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb416d-3b95-43de-8eb3-685b8ac64921 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:53.679511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb416d-3b95-43de-8eb3-685b8ac64921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:53.781964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb416d-3b95-43de-8eb3-685b8ac64921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:53.783524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb416d-3b95-43de-8eb3-685b8ac64921 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:53.900124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:53.915656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 175/377] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 12:34:53.922944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:53.943666 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0b006-78a8-4c63-b205-c5740a36393e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:53.943841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0b006-78a8-4c63-b205-c5740a36393e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:53.944129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0b006-78a8-4c63-b205-c5740a36393e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:53.945796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 176/378] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:34:53.963539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c97d9-3c41-4522-98f1-15615d703007 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:53.963878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c97d9-3c41-4522-98f1-15615d703007 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:53.964101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c97d9-3c41-4522-98f1-15615d703007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:53.977433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:53.996348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-db6c97d9-3c41-4522-98f1-15615d703007 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:53.997930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-db6c97d9-3c41-4522-98f1-15615d703007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:54.095296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 177/379] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:54.116749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575080b-0324-4c73-8d52-7d730be50ebe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:54.174726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5477-8f5d-43a6-8acf-608fc56eac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:54.175390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5477-8f5d-43a6-8acf-608fc56eac2b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:54.176244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5477-8f5d-43a6-8acf-608fc56eac2b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:54.176520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5477-8f5d-43a6-8acf-608fc56eac2b None admin] PATH_INFO: `/v3/projects/71839b182c07466f9bb5d0732665873b` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:54.178322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e5477-8f5d-43a6-8acf-608fc56eac2b None admin] RBAC: Authorizing `identity:get_project(project_id=71839b182c07466f9bb5d0732665873b)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:54.179803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e5477-8f5d-43a6-8acf-608fc56eac2b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:54.181539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 203/380] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:53 2022] GET /identity/v3/projects/71839b182c07466f9bb5d0732665873b => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:54.188370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c97d9-3c41-4522-98f1-15615d703007 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:54.328690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c97d9-3c41-4522-98f1-15615d703007 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:54.355446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:54.376385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544ca52-5f86-466e-99a1-365f7c743ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:54.377043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ca52-5f86-466e-99a1-365f7c743ebd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:54.377321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ca52-5f86-466e-99a1-365f7c743ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:54.377620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ca52-5f86-466e-99a1-365f7c743ebd None admin] PATH_INFO: `/v3/groups/dd3db468e2e446baab4b56b3849495b9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:54.384551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544ca52-5f86-466e-99a1-365f7c743ebd None admin] RBAC: Authorizing `identity:get_group(group_id=dd3db468e2e446baab4b56b3849495b9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:54.386098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544ca52-5f86-466e-99a1-365f7c743ebd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:54.388159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 178/381] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:54 2022] GET /identity/v3/groups/dd3db468e2e446baab4b56b3849495b9 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:54.394124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5477-8f5d-43a6-8acf-608fc56eac2b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:54.527064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544ca52-5f86-466e-99a1-365f7c743ebd None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:54.550379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:54.567531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5477-8f5d-43a6-8acf-608fc56eac2b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:54.611619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:54.612253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:54.612534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:54.612812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:54.613627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] RBAC: Adding query filter params (group.id=dd3db468e2e446baab4b56b3849495b9, role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=71839b182c07466f9bb5d0732665873b) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:54.614102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:54.615770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:54.622423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 204/382] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:34:54 2022] GET /identity/v3/role_assignments?group.id=dd3db468e2e446baab4b56b3849495b9&scope.project.id=71839b182c07466f9bb5d0732665873b&role.id=b8bf66974c0448089a192ead432a35f2 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:54.810836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544ca52-5f86-466e-99a1-365f7c743ebd None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:54.887025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75bd94-e4b5-44a9-84ca-d503a7737187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:54.888138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75bd94-e4b5-44a9-84ca-d503a7737187 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:54.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75bd94-e4b5-44a9-84ca-d503a7737187 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:54.889117 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75bd94-e4b5-44a9-84ca-d503a7737187 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:54.909869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75bd94-e4b5-44a9-84ca-d503a7737187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6a75bd94-e4b5-44a9-84ca-d503a7737187 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:54.915680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:54.916633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:54.918307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 179/383] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:34:54.926157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:55.066329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcffa13-f0e5-449a-87fd-b0ba1cd0fb51 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:55.115934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:55.116571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:55.116858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:55.117140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:55.117924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:55.118233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:55.119640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:55.134158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 205/384] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:55.140679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75bd94-e4b5-44a9-84ca-d503a7737187 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:55.261088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:55.398479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75bd94-e4b5-44a9-84ca-d503a7737187 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:55.446095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d802-8666-41a8-b069-0707ee9a6402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:55.447030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d802-8666-41a8-b069-0707ee9a6402 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:55.447454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d802-8666-41a8-b069-0707ee9a6402 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:55.447875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053d802-8666-41a8-b069-0707ee9a6402 None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:55.449233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053d802-8666-41a8-b069-0707ee9a6402 None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:55.450987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053d802-8666-41a8-b069-0707ee9a6402 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:55.453116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 180/385] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:55 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:34:55.458999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:55.485369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:55.589539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb58d7-af0f-4c91-9f6a-a16cf5c62dc9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:55.635562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8bc33-3ddd-4b6a-8d46-f36ed3f93d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:55.636613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8bc33-3ddd-4b6a-8d46-f36ed3f93d8e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:55.637119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8bc33-3ddd-4b6a-8d46-f36ed3f93d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:55.637629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8bc33-3ddd-4b6a-8d46-f36ed3f93d8e None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:55.642676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8bc33-3ddd-4b6a-8d46-f36ed3f93d8e None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:55.645219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8bc33-3ddd-4b6a-8d46-f36ed3f93d8e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:55.647948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 206/386] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:55 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:55.653919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d802-8666-41a8-b069-0707ee9a6402 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:55.783301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053d802-8666-41a8-b069-0707ee9a6402 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:55.798922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:55.824997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d79ff0-a0ca-4351-9f34-ab4efe1e7ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:55.826553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79ff0-a0ca-4351-9f34-ab4efe1e7ea3 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:55.827042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79ff0-a0ca-4351-9f34-ab4efe1e7ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:55.827518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79ff0-a0ca-4351-9f34-ab4efe1e7ea3 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/groups/a5d164dec3bb46b7a4cabd5229a53c93/roles/0adab6046ed34edf8914c4971198655f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:55.830069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d79ff0-a0ca-4351-9f34-ab4efe1e7ea3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f289526ed98a4fe38c3ad61be0ecd099, group_id=a5d164dec3bb46b7a4cabd5229a53c93, role_id=0adab6046ed34edf8914c4971198655f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:55.831889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d79ff0-a0ca-4351-9f34-ab4efe1e7ea3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:55.854089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 181/387] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Oct 4 12:34:55 2022] PUT /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/groups/a5d164dec3bb46b7a4cabd5229a53c93/roles/0adab6046ed34edf8914c4971198655f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:55.917703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713e7b-484e-4578-845e-989f9b706410 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:55.918100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713e7b-484e-4578-845e-989f9b706410 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:55.918541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713e7b-484e-4578-845e-989f9b706410 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:55.921590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 207/388] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:55.930943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f3db4-b103-4028-820f-de12eeb655d9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:55.931349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f3db4-b103-4028-820f-de12eeb655d9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:55.931500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f3db4-b103-4028-820f-de12eeb655d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:55.953016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a31f3db4-b103-4028-820f-de12eeb655d9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:55.954297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a31f3db4-b103-4028-820f-de12eeb655d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:56.079377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 182/389] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:34:56.533906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cfa9a-bfdd-4061-9795-f11bb0209724 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:56.535468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cfa9a-bfdd-4061-9795-f11bb0209724 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:56.536214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cfa9a-bfdd-4061-9795-f11bb0209724 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:56.539102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 208/390] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:56.557937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8d977-4d99-4805-8798-799507b08f2f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:56.558847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8d977-4d99-4805-8798-799507b08f2f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:56.559553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8d977-4d99-4805-8798-799507b08f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:56.602141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5ec8d977-4d99-4805-8798-799507b08f2f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:56.604708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5ec8d977-4d99-4805-8798-799507b08f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:56.631182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10568173-a422-4052-a746-ee7dc24edf8a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:56.631939 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10568173-a422-4052-a746-ee7dc24edf8a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:56.631939 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10568173-a422-4052-a746-ee7dc24edf8a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:56.633382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 209/391] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:56.638923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c317-2958-4cfa-9d8e-73ea5315cb6d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:56.639202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c317-2958-4cfa-9d8e-73ea5315cb6d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:56.639512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c317-2958-4cfa-9d8e-73ea5315cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:56.661847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-35f8c317-2958-4cfa-9d8e-73ea5315cb6d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:56.663084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-35f8c317-2958-4cfa-9d8e-73ea5315cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:56.788303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 183/392] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:56.788780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 210/393] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:56.790731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8d977-4d99-4805-8798-799507b08f2f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:56.861942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:56.999583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8d977-4d99-4805-8798-799507b08f2f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:57.082100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1e519-3394-4b6c-8f69-4931b1c9c917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:57.083060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1e519-3394-4b6c-8f69-4931b1c9c917 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:57.083550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1e519-3394-4b6c-8f69-4931b1c9c917 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:57.084054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1e519-3394-4b6c-8f69-4931b1c9c917 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:57.109491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1e519-3394-4b6c-8f69-4931b1c9c917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f6f1e519-3394-4b6c-8f69-4931b1c9c917 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:57.120065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:57.121796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:57.123359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:57.127363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 184/394] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:57.136388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c317-2958-4cfa-9d8e-73ea5315cb6d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:57.176831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:57.180997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1e519-3394-4b6c-8f69-4931b1c9c917 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:57.344212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c317-2958-4cfa-9d8e-73ea5315cb6d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:57.375970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:57.397376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1e519-3394-4b6c-8f69-4931b1c9c917 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:57.429743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:57.430377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:57.430659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:57.430929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:57.432601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:57.432601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:57.433923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:57.445274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 211/395] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:57.447296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:57.483587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e0d79-8b5e-4ed3-b367-aab1dba4f0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:57.485840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e0d79-8b5e-4ed3-b367-aab1dba4f0f6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:57.486184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e0d79-8b5e-4ed3-b367-aab1dba4f0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:57.486425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e0d79-8b5e-4ed3-b367-aab1dba4f0f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:57.500190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e0d79-8b5e-4ed3-b367-aab1dba4f0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c68e0d79-8b5e-4ed3-b367-aab1dba4f0f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:57.505383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:57.507426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:34:57.509332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:34:57.511827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 185/396] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:57.512835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e0d79-8b5e-4ed3-b367-aab1dba4f0f6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:57.593790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:57.634010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e0d79-8b5e-4ed3-b367-aab1dba4f0f6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:57.638726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e9859-fe25-4186-a21d-33aff1e48b0a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:57.690111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b797ec4-acc7-4de2-9d3e-240cf7c7d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:57.691478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797ec4-acc7-4de2-9d3e-240cf7c7d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:57.691759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797ec4-acc7-4de2-9d3e-240cf7c7d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:57.692033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797ec4-acc7-4de2-9d3e-240cf7c7d7c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:57.705646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b797ec4-acc7-4de2-9d3e-240cf7c7d7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:57.707229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c921475-7416-4e07-b6a1-5c65069a1501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:57.708601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c921475-7416-4e07-b6a1-5c65069a1501 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:57.709305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c921475-7416-4e07-b6a1-5c65069a1501 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:57.710062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c921475-7416-4e07-b6a1-5c65069a1501 None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3b797ec4-acc7-4de2-9d3e-240cf7c7d7c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:57.711802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:57.713698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:34:57.715421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:57.717330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c921475-7416-4e07-b6a1-5c65069a1501 None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:57.718153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 212/397] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:57.719119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b797ec4-acc7-4de2-9d3e-240cf7c7d7c6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:57.721108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c921475-7416-4e07-b6a1-5c65069a1501 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:57.727247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 186/398] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:57 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:57.729262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c921475-7416-4e07-b6a1-5c65069a1501 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:57.774502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:57.888058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b797ec4-acc7-4de2-9d3e-240cf7c7d7c6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:57.891410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c921475-7416-4e07-b6a1-5c65069a1501 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:57.934635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:57.935248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:57.935541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:57.935900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:57.936465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525373b7-dc86-4c2c-9469-09e9eaf274bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:57.936638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:57.936910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:57.937361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525373b7-dc86-4c2c-9469-09e9eaf274bb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:57.937806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525373b7-dc86-4c2c-9469-09e9eaf274bb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:57.938216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525373b7-dc86-4c2c-9469-09e9eaf274bb None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:57.938364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:57.939079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525373b7-dc86-4c2c-9469-09e9eaf274bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:57.939516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525373b7-dc86-4c2c-9469-09e9eaf274bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:57.942262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525373b7-dc86-4c2c-9469-09e9eaf274bb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:57.955568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 187/399] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:34:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:57.955568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:57.959193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:57.962630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 213/400] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:34:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:57.969693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404ab7f-5944-4138-a1d0-c9432ea07690 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:57.969693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404ab7f-5944-4138-a1d0-c9432ea07690 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:57.969693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404ab7f-5944-4138-a1d0-c9432ea07690 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:57.969693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 214/401] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:34:57.971508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404ab7f-5944-4138-a1d0-c9432ea07690 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:58.077963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:58.109622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2aba2-4589-45b7-b2f8-c2b2fd963bd0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:58.120660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404ab7f-5944-4138-a1d0-c9432ea07690 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:58.165104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c41fc-6920-479c-bde0-a449e2484ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:58.165791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c41fc-6920-479c-bde0-a449e2484ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:58.166011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c41fc-6920-479c-bde0-a449e2484ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:58.166285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c41fc-6920-479c-bde0-a449e2484ae5 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:58.167523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c41fc-6920-479c-bde0-a449e2484ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:58.169058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c41fc-6920-479c-bde0-a449e2484ae5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:58.176484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad970b-8125-4058-9aca-3c44ac4786ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:58.176686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 188/402] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:57 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:58.176686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c41fc-6920-479c-bde0-a449e2484ae5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:58.176844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad970b-8125-4058-9aca-3c44ac4786ba None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:58.176844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad970b-8125-4058-9aca-3c44ac4786ba None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:58.176844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad970b-8125-4058-9aca-3c44ac4786ba None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:58.177643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad970b-8125-4058-9aca-3c44ac4786ba None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:58.180231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad970b-8125-4058-9aca-3c44ac4786ba None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:58.182703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 215/403] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:57 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:58.184842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82882-cfea-4118-9766-2b39b5a7b726 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:58.185329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82882-cfea-4118-9766-2b39b5a7b726 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:58.185865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82882-cfea-4118-9766-2b39b5a7b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:58.214704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e4b82882-cfea-4118-9766-2b39b5a7b726 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:34:58.216142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e4b82882-cfea-4118-9766-2b39b5a7b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:34:58.323748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:58.331532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 216/404] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:34:58.332381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b82882-cfea-4118-9766-2b39b5a7b726 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:58.357532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c41fc-6920-479c-bde0-a449e2484ae5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:58.436272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf7ec0-f832-4982-8663-37eb193f28bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:58.437873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf7ec0-f832-4982-8663-37eb193f28bb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:58.438664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf7ec0-f832-4982-8663-37eb193f28bb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:58.439571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf7ec0-f832-4982-8663-37eb193f28bb None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:58.442084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf7ec0-f832-4982-8663-37eb193f28bb None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:58.445486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf7ec0-f832-4982-8663-37eb193f28bb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:58.449676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 189/405] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:58 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:58.451591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf7ec0-f832-4982-8663-37eb193f28bb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:58.452495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b82882-cfea-4118-9766-2b39b5a7b726 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:58.490982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389eab1c-f79d-4de7-a59f-354a44dec5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:58.491592 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eab1c-f79d-4de7-a59f-354a44dec5b0 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:58.491875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eab1c-f79d-4de7-a59f-354a44dec5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:58.492148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389eab1c-f79d-4de7-a59f-354a44dec5b0 None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/groups/a5d164dec3bb46b7a4cabd5229a53c93/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:58.494222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389eab1c-f79d-4de7-a59f-354a44dec5b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f289526ed98a4fe38c3ad61be0ecd099, group_id=a5d164dec3bb46b7a4cabd5229a53c93, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:58.494712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:58.495826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389eab1c-f79d-4de7-a59f-354a44dec5b0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:58.512609 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 217/406] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Oct 4 12:34:58 2022] PUT /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099/groups/a5d164dec3bb46b7a4cabd5229a53c93/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:58.514811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389eab1c-f79d-4de7-a59f-354a44dec5b0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:58.645958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:58.696572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf7ec0-f832-4982-8663-37eb193f28bb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:58.736761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389eab1c-f79d-4de7-a59f-354a44dec5b0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:58.767320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a6bc1-9871-4cc6-aae8-636d84aa4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:58.769637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a6bc1-9871-4cc6-aae8-636d84aa4964 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:58.770397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a6bc1-9871-4cc6-aae8-636d84aa4964 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:58.771085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a6bc1-9871-4cc6-aae8-636d84aa4964 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:58.773900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a6bc1-9871-4cc6-aae8-636d84aa4964 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:58.777363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a6bc1-9871-4cc6-aae8-636d84aa4964 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:58.778059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e719aa7-041c-4807-82c1-f0e70be1c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:58.778641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e719aa7-041c-4807-82c1-f0e70be1c3be None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:58.778918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e719aa7-041c-4807-82c1-f0e70be1c3be None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:58.779188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e719aa7-041c-4807-82c1-f0e70be1c3be None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:58.780502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e719aa7-041c-4807-82c1-f0e70be1c3be None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:58.782051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e719aa7-041c-4807-82c1-f0e70be1c3be None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:58.783312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 190/407] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:58 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:58.790161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 218/408] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:58 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:58.792228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a6bc1-9871-4cc6-aae8-636d84aa4964 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:58.798621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e719aa7-041c-4807-82c1-f0e70be1c3be None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:58.944224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e719aa7-041c-4807-82c1-f0e70be1c3be None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:58.961250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:58.979361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:58.992815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a6bc1-9871-4cc6-aae8-636d84aa4964 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:58.994433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ce88-82b9-4724-ba18-3bb72e2daec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:58.995348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ce88-82b9-4724-ba18-3bb72e2daec3 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:58.995814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ce88-82b9-4724-ba18-3bb72e2daec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:58.996261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38ce88-82b9-4724-ba18-3bb72e2daec3 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876/groups/a5d164dec3bb46b7a4cabd5229a53c93/roles/0adab6046ed34edf8914c4971198655f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:58.999518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38ce88-82b9-4724-ba18-3bb72e2daec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e3776e5294421c871d6041b669b876, group_id=a5d164dec3bb46b7a4cabd5229a53c93, role_id=0adab6046ed34edf8914c4971198655f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:59.001303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38ce88-82b9-4724-ba18-3bb72e2daec3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:59.018906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 219/409] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Oct 4 12:34:58 2022] PUT /identity/v3/projects/05e3776e5294421c871d6041b669b876/groups/a5d164dec3bb46b7a4cabd5229a53c93/roles/0adab6046ed34edf8914c4971198655f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:34:59.020852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ce88-82b9-4724-ba18-3bb72e2daec3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:59.072167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540c1ae-cde2-4549-b313-a294a7b685c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:59.073329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c1ae-cde2-4549-b313-a294a7b685c0 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:59.074210 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c1ae-cde2-4549-b313-a294a7b685c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:59.074668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c1ae-cde2-4549-b313-a294a7b685c0 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876/groups/a5d164dec3bb46b7a4cabd5229a53c93/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:59.078624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540c1ae-cde2-4549-b313-a294a7b685c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e3776e5294421c871d6041b669b876, group_id=a5d164dec3bb46b7a4cabd5229a53c93, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:59.083494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540c1ae-cde2-4549-b313-a294a7b685c0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:59.117402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 191/410] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Oct 4 12:34:58 2022] PUT /identity/v3/projects/05e3776e5294421c871d6041b669b876/groups/a5d164dec3bb46b7a4cabd5229a53c93/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:34:59.236747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38ce88-82b9-4724-ba18-3bb72e2daec3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:59.292560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f84d-f676-4603-9601-bb61d3562197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:59.293517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f84d-f676-4603-9601-bb61d3562197 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:59.294066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f84d-f676-4603-9601-bb61d3562197 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:59.294479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307f84d-f676-4603-9601-bb61d3562197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:59.314568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307f84d-f676-4603-9601-bb61d3562197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7307f84d-f676-4603-9601-bb61d3562197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:34:59.320320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:34:59.321365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:34:59.322254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:34:59.324179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 220/411] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:34:59.333526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540c1ae-cde2-4549-b313-a294a7b685c0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:59.526725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540c1ae-cde2-4549-b313-a294a7b685c0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:59.600868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:59.601947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:59.602419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:59.602894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:59.604079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:34:59.604627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:59.607215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:59.633223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 192/412] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:59.642088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f84d-f676-4603-9601-bb61d3562197 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:59.761575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:34:59.875729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307f84d-f676-4603-9601-bb61d3562197 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:34:59.941477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4792-d983-4b0d-8ae5-3b4d41060965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:34:59.942427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4792-d983-4b0d-8ae5-3b4d41060965 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:34:59.942817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4792-d983-4b0d-8ae5-3b4d41060965 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:34:59.943197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4792-d983-4b0d-8ae5-3b4d41060965 None admin] PATH_INFO: `/v3/groups/dd3db468e2e446baab4b56b3849495b9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:34:59.944913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a4792-d983-4b0d-8ae5-3b4d41060965 None admin] RBAC: Authorizing `identity:get_group(group_id=dd3db468e2e446baab4b56b3849495b9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:34:59.947138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a4792-d983-4b0d-8ae5-3b4d41060965 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:34:59.950276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 221/413] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:34:59 2022] GET /identity/v3/groups/dd3db468e2e446baab4b56b3849495b9 => generated 229 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:34:59.959440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:34:59.980592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:00.087509 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba6dd-2e7d-4a6b-939c-9de56f700eb0 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:00.087972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba6dd-2e7d-4a6b-939c-9de56f700eb0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:00.088450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ba6dd-2e7d-4a6b-939c-9de56f700eb0 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:00.092272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 222/414] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:00.104221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9745-4a3a-4cbc-9e42-0a7fb532c93c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:00.104705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9745-4a3a-4cbc-9e42-0a7fb532c93c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:00.105174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9745-4a3a-4cbc-9e42-0a7fb532c93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:00.146197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-badb9745-4a3a-4cbc-9e42-0a7fb532c93c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:00.148561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-badb9745-4a3a-4cbc-9e42-0a7fb532c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:00.161802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d97f4-999c-42f0-833f-2d26b52863b1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:00.232668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e7c0e-c38e-4b52-95a9-e95a6642fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:00.233784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7c0e-c38e-4b52-95a9-e95a6642fd6f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:00.234300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7c0e-c38e-4b52-95a9-e95a6642fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:00.234799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7c0e-c38e-4b52-95a9-e95a6642fd6f None admin] PATH_INFO: `/v3/projects/71839b182c07466f9bb5d0732665873b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:00.236760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e7c0e-c38e-4b52-95a9-e95a6642fd6f None admin] RBAC: Authorizing `identity:get_project(project_id=71839b182c07466f9bb5d0732665873b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:00.239455 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e7c0e-c38e-4b52-95a9-e95a6642fd6f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:00.244259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 193/415] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:34:59 2022] GET /identity/v3/projects/71839b182c07466f9bb5d0732665873b => generated 344 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:00.252724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e7c0e-c38e-4b52-95a9-e95a6642fd6f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:00.326959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 223/416] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:00.387752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:00.435930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e7c0e-c38e-4b52-95a9-e95a6642fd6f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:00.528207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761836b7-014c-43e3-afc7-f066328b86cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:00.529404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761836b7-014c-43e3-afc7-f066328b86cd None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:00.529940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761836b7-014c-43e3-afc7-f066328b86cd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:00.530443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761836b7-014c-43e3-afc7-f066328b86cd None admin] PATH_INFO: `/v3/projects/71839b182c07466f9bb5d0732665873b/groups/dd3db468e2e446baab4b56b3849495b9/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:00.535260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761836b7-014c-43e3-afc7-f066328b86cd None admin] RBAC: Authorizing `identity:create_grant(project_id=71839b182c07466f9bb5d0732665873b, group_id=dd3db468e2e446baab4b56b3849495b9, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:00.537102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761836b7-014c-43e3-afc7-f066328b86cd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:00.565634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 194/417] 10.222.0.30 () {58 vars in 1442 bytes} [Tue Oct 4 12:35:00 2022] PUT /identity/v3/projects/71839b182c07466f9bb5d0732665873b/groups/dd3db468e2e446baab4b56b3849495b9/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:35:00.977872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb9745-4a3a-4cbc-9e42-0a7fb532c93c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:01.034112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:01.104747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb9745-4a3a-4cbc-9e42-0a7fb532c93c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:01.147578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560f4cd-630d-4141-836c-f23d805ce7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:01.148551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f4cd-630d-4141-836c-f23d805ce7aa None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:01.148977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f4cd-630d-4141-836c-f23d805ce7aa None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:01.149390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560f4cd-630d-4141-836c-f23d805ce7aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:01.163795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560f4cd-630d-4141-836c-f23d805ce7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-9560f4cd-630d-4141-836c-f23d805ce7aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:01.169123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:01.170257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:35:01.171174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:01.173660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 224/418] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:35:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:01.183309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761836b7-014c-43e3-afc7-f066328b86cd None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:01.451929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761836b7-014c-43e3-afc7-f066328b86cd None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:01.535913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:01.536910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:01.537344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:01.537800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:01.538918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:01.539436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:01.541935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:01.551546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:01.563955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 195/419] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:01.570381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560f4cd-630d-4141-836c-f23d805ce7aa None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:01.682123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560f4cd-630d-4141-836c-f23d805ce7aa None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:01.685636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:01.721522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907496b-a0d3-4c9a-98d0-81c3d4b7c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:01.722656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907496b-a0d3-4c9a-98d0-81c3d4b7c10e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:01.723178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907496b-a0d3-4c9a-98d0-81c3d4b7c10e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:01.723660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907496b-a0d3-4c9a-98d0-81c3d4b7c10e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:01.798328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907496b-a0d3-4c9a-98d0-81c3d4b7c10e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:01.800165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907496b-a0d3-4c9a-98d0-81c3d4b7c10e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:01.913826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 225/420] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:01.919066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:02.032421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59396b2-34c0-47db-b2fc-6e50ea7d684c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:02.074607 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61eace-b153-4c2b-845a-6ce4e74d62ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:02.075703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eace-b153-4c2b-845a-6ce4e74d62ee None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:02.076180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eace-b153-4c2b-845a-6ce4e74d62ee None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:02.076648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61eace-b153-4c2b-845a-6ce4e74d62ee None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:02.078116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61eace-b153-4c2b-845a-6ce4e74d62ee None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:02.079791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61eace-b153-4c2b-845a-6ce4e74d62ee None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:02.082098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 196/421] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:35:01 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:02.091288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907496b-a0d3-4c9a-98d0-81c3d4b7c10e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:02.110244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:02.210323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907496b-a0d3-4c9a-98d0-81c3d4b7c10e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:02.254064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e5cc6-fa18-4707-a753-d3f40137f64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:02.255136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e5cc6-fa18-4707-a753-d3f40137f64b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:02.255615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e5cc6-fa18-4707-a753-d3f40137f64b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:02.256104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e5cc6-fa18-4707-a753-d3f40137f64b None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:02.257799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e5cc6-fa18-4707-a753-d3f40137f64b None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:02.259603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e5cc6-fa18-4707-a753-d3f40137f64b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:02.262078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 226/422] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:35:02 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:02.271914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61eace-b153-4c2b-845a-6ce4e74d62ee None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:02.450302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:02.482947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61eace-b153-4c2b-845a-6ce4e74d62ee None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:02.546889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717a4b-0f69-4941-b528-c385880dddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:02.547905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717a4b-0f69-4941-b528-c385880dddac None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:02.548388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717a4b-0f69-4941-b528-c385880dddac None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:02.548872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717a4b-0f69-4941-b528-c385880dddac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:02.550217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42717a4b-0f69-4941-b528-c385880dddac None admin] RBAC: Adding query filter params (group.id=a5d164dec3bb46b7a4cabd5229a53c93, role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:02.550769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42717a4b-0f69-4941-b528-c385880dddac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:02.553383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42717a4b-0f69-4941-b528-c385880dddac None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:02.565287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 197/423] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:35:02 2022] GET /identity/v3/role_assignments?group.id=a5d164dec3bb46b7a4cabd5229a53c93&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=0adab6046ed34edf8914c4971198655f => generated 611 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:02.737307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e7d15-27ec-4357-9670-651dd4a29025 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:02.738412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e7d15-27ec-4357-9670-651dd4a29025 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:02.739229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e7d15-27ec-4357-9670-651dd4a29025 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:02.742216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 227/424] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:02.749455 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b9563-ed9f-4874-a86a-1ad72a3a483e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:02.750464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b9563-ed9f-4874-a86a-1ad72a3a483e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:02.751255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b9563-ed9f-4874-a86a-1ad72a3a483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:02.791167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4b6b9563-ed9f-4874-a86a-1ad72a3a483e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:02.793541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4b6b9563-ed9f-4874-a86a-1ad72a3a483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:02.891931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978b0b-d3a6-42a0-8393-61dccf6bf887 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:02.892662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978b0b-d3a6-42a0-8393-61dccf6bf887 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:02.893263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978b0b-d3a6-42a0-8393-61dccf6bf887 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:02.898446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 228/425] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:02.909196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25247-fd3f-4de2-9426-ac556685fd88 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:02.909775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25247-fd3f-4de2-9426-ac556685fd88 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:02.910278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25247-fd3f-4de2-9426-ac556685fd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:02.926480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 198/426] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:02.950931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d1d25247-fd3f-4de2-9426-ac556685fd88 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:02.953421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d1d25247-fd3f-4de2-9426-ac556685fd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:03.094532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 229/427] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:03.172610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81a77-f360-472f-8f29-1211920fbd7c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:03.173107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81a77-f360-472f-8f29-1211920fbd7c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:03.173580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81a77-f360-472f-8f29-1211920fbd7c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:03.176777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 199/428] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:03.189384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c9cb-4888-4a03-919a-3559aa205cf8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:03.189911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c9cb-4888-4a03-919a-3559aa205cf8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:03.190405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c9cb-4888-4a03-919a-3559aa205cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:03.203449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:03.225106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d81a77-f360-472f-8f29-1211920fbd7c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:03.225569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ea07c9cb-4888-4a03-919a-3559aa205cf8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:03.227507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ea07c9cb-4888-4a03-919a-3559aa205cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:03.296654 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:03.348091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d81a77-f360-472f-8f29-1211920fbd7c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:03.395549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e839c7-75cc-4e19-b32b-1442e325c09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:03.396582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e839c7-75cc-4e19-b32b-1442e325c09a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:03.397064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e839c7-75cc-4e19-b32b-1442e325c09a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:03.397536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e839c7-75cc-4e19-b32b-1442e325c09a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:03.403047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 230/429] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:03.410958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e839c7-75cc-4e19-b32b-1442e325c09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-09e839c7-75cc-4e19-b32b-1442e325c09a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:03.416412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:03.417373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:35:03.418205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:03.421885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 200/430] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:03.430025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07c9cb-4888-4a03-919a-3559aa205cf8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:03.619673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07c9cb-4888-4a03-919a-3559aa205cf8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:03.626033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e839c7-75cc-4e19-b32b-1442e325c09a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:03.680199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:03.690172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:03.691663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:03.692309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:03.692789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:03.694059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:03.694616 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:03.698802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:03.716980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 231/431] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:03.718632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:03.748145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e839c7-75cc-4e19-b32b-1442e325c09a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:03.770308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:03.792560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1a3ae-23f7-4261-8067-1f5c2c6c2ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:03.793985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a3ae-23f7-4261-8067-1f5c2c6c2ff9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:03.794759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a3ae-23f7-4261-8067-1f5c2c6c2ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:03.795444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1a3ae-23f7-4261-8067-1f5c2c6c2ff9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:03.815673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1a3ae-23f7-4261-8067-1f5c2c6c2ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6de1a3ae-23f7-4261-8067-1f5c2c6c2ff9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:03.826288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:03.828330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 12:35:03.830356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:03.832799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 201/432] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:03.833155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1a3ae-23f7-4261-8067-1f5c2c6c2ff9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:03.852626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9d484-930a-4d37-8619-03fa9f8dad75 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:03.894555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6372e-88fb-40fb-b734-aef319013a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:03.895548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6372e-88fb-40fb-b734-aef319013a63 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:03.895548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6372e-88fb-40fb-b734-aef319013a63 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:03.895841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6372e-88fb-40fb-b734-aef319013a63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:03.915118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6372e-88fb-40fb-b734-aef319013a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b9b6372e-88fb-40fb-b734-aef319013a63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:03.926471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:03.927410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:35:03.928164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:03.928752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 232/433] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:35:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:03.929954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6372e-88fb-40fb-b734-aef319013a63 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:04.015854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:04.017896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1a3ae-23f7-4261-8067-1f5c2c6c2ff9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:04.081251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c410db-98e7-44c1-8606-f5adc2cdbf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:04.082182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c410db-98e7-44c1-8606-f5adc2cdbf63 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.082580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c410db-98e7-44c1-8606-f5adc2cdbf63 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.082975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c410db-98e7-44c1-8606-f5adc2cdbf63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.105809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6372e-88fb-40fb-b734-aef319013a63 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:04.167042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:04.167708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.168093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.168383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:04.168561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.169711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] RBAC: Adding query filter params (name=member) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:04.170110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:04.172560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:04.186868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 233/434] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:04.188138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:04.207984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c410db-98e7-44c1-8606-f5adc2cdbf63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:04.209817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c410db-98e7-44c1-8606-f5adc2cdbf63 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:04.320211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 202/435] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:04.321491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897ee29-903e-417f-bfac-a175a53e7717 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.321808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897ee29-903e-417f-bfac-a175a53e7717 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.322054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897ee29-903e-417f-bfac-a175a53e7717 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.325653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 203/436] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:04.325653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897ee29-903e-417f-bfac-a175a53e7717 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:04.333141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486921f-a714-43e3-9764-4042ca06506a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:04.353997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:04.385163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:04.386306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.386815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.387303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.388517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:04.389068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:04.391723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:04.410369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 234/437] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:04.410369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:04.423634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:04.456978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897ee29-903e-417f-bfac-a175a53e7717 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:04.503634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dacd4b-dd1c-4b99-b3ff-41523965f437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:04.504662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dacd4b-dd1c-4b99-b3ff-41523965f437 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.505153 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dacd4b-dd1c-4b99-b3ff-41523965f437 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.505685 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dacd4b-dd1c-4b99-b3ff-41523965f437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.531297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7ecd-8138-4072-a00a-8710c373481c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:04.571169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bca23-05cf-47f5-b9f0-41ca2e4f24b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:04.571805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bca23-05cf-47f5-b9f0-41ca2e4f24b7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.572084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bca23-05cf-47f5-b9f0-41ca2e4f24b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.572368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bca23-05cf-47f5-b9f0-41ca2e4f24b7 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.573540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bca23-05cf-47f5-b9f0-41ca2e4f24b7 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:04.575024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bca23-05cf-47f5-b9f0-41ca2e4f24b7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:04.576674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 235/438] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:35:04 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:04.577947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f131c9-910e-4089-b46b-f2bf7d11ce05 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.578239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f131c9-910e-4089-b46b-f2bf7d11ce05 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.578503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f131c9-910e-4089-b46b-f2bf7d11ce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.598314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-75f131c9-910e-4089-b46b-f2bf7d11ce05 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:04.599515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-75f131c9-910e-4089-b46b-f2bf7d11ce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:04.609125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dacd4b-dd1c-4b99-b3ff-41523965f437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:04.611801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dacd4b-dd1c-4b99-b3ff-41523965f437 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:04.652054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:04.695331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 236/439] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:04.696772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f131c9-910e-4089-b46b-f2bf7d11ce05 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:04.715257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:04.745131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 204/440] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:04.746316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dacd4b-dd1c-4b99-b3ff-41523965f437 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:04.885420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f131c9-910e-4089-b46b-f2bf7d11ce05 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:04.923234 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dacd4b-dd1c-4b99-b3ff-41523965f437 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:04.926747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8a335-9577-4dda-9882-408de9598431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:04.928272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a335-9577-4dda-9882-408de9598431 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.928548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a335-9577-4dda-9882-408de9598431 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.928819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8a335-9577-4dda-9882-408de9598431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.989403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:04.990356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ef00-cc69-468e-b119-399b8598ad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:04.991510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ef00-cc69-468e-b119-399b8598ad63 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:04.992038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ef00-cc69-468e-b119-399b8598ad63 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:04.992713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ef00-cc69-468e-b119-399b8598ad63 None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:04.994779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144ef00-cc69-468e-b119-399b8598ad63 None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:04.997458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144ef00-cc69-468e-b119-399b8598ad63 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.001641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 205/441] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:35:04 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:05.002444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ef00-cc69-468e-b119-399b8598ad63 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.026911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8a335-9577-4dda-9882-408de9598431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:05.028933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8a335-9577-4dda-9882-408de9598431 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.091002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:05.140302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 237/442] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:05.141284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8a335-9577-4dda-9882-408de9598431 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.162546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ef00-cc69-468e-b119-399b8598ad63 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:05.215069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847d146-a14b-4991-9d6b-2bc74c8d51ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:05.215876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847d146-a14b-4991-9d6b-2bc74c8d51ab None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:05.216250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847d146-a14b-4991-9d6b-2bc74c8d51ab None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:05.216674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847d146-a14b-4991-9d6b-2bc74c8d51ab None admin] PATH_INFO: `/v3/projects/f289526ed98a4fe38c3ad61be0ecd099` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:05.218353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847d146-a14b-4991-9d6b-2bc74c8d51ab None admin] RBAC: Authorizing `identity:get_project(project_id=f289526ed98a4fe38c3ad61be0ecd099)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:05.220125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847d146-a14b-4991-9d6b-2bc74c8d51ab None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.222238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 206/443] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/projects/f289526ed98a4fe38c3ad61be0ecd099 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:05.223389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847d146-a14b-4991-9d6b-2bc74c8d51ab None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.272117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:05.303972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8a335-9577-4dda-9882-408de9598431 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:05.352123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:05.352741 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:05.353026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:05.353296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:05.354099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] RBAC: Adding query filter params (group.id=a5d164dec3bb46b7a4cabd5229a53c93, role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=05e3776e5294421c871d6041b669b876) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:05.354397 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:05.355887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.362554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 238/444] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/role_assignments?group.id=a5d164dec3bb46b7a4cabd5229a53c93&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:05.373863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.384950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847d146-a14b-4991-9d6b-2bc74c8d51ab None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:05.406950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:05.432746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43c160-200e-4281-8e88-04f68eb08515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:05.433738 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43c160-200e-4281-8e88-04f68eb08515 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:05.434147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43c160-200e-4281-8e88-04f68eb08515 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:05.434551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43c160-200e-4281-8e88-04f68eb08515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:05.449495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43c160-200e-4281-8e88-04f68eb08515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-de43c160-200e-4281-8e88-04f68eb08515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:05.456331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:05.458632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:05.460225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 207/445] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:05.462966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43c160-200e-4281-8e88-04f68eb08515 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.547111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4dc2a-3e9e-420b-833c-9a755e510d9f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:05.603790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0e2a-461a-4c7f-84a2-5714cc015107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:05.604429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0e2a-461a-4c7f-84a2-5714cc015107 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:05.604782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0e2a-461a-4c7f-84a2-5714cc015107 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:05.605063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0e2a-461a-4c7f-84a2-5714cc015107 None admin] PATH_INFO: `/v3/projects/05e3776e5294421c871d6041b669b876` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:05.608578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0e2a-461a-4c7f-84a2-5714cc015107 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3776e5294421c871d6041b669b876)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:05.608801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0e2a-461a-4c7f-84a2-5714cc015107 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.610644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 239/446] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/projects/05e3776e5294421c871d6041b669b876 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:05.613259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43c160-200e-4281-8e88-04f68eb08515 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:05.613394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0e2a-461a-4c7f-84a2-5714cc015107 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.627165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:05.659850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453551-4a70-410f-9d7a-603bf0833f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:05.660491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453551-4a70-410f-9d7a-603bf0833f3b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:05.660766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453551-4a70-410f-9d7a-603bf0833f3b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:05.661039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45453551-4a70-410f-9d7a-603bf0833f3b None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:05.662247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45453551-4a70-410f-9d7a-603bf0833f3b None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:05.663711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45453551-4a70-410f-9d7a-603bf0833f3b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.665332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 208/447] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:05.666138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453551-4a70-410f-9d7a-603bf0833f3b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.715555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:05.749068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0e2a-461a-4c7f-84a2-5714cc015107 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:05.780897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45453551-4a70-410f-9d7a-603bf0833f3b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:05.791704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:05.792328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:05.792599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:05.792870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:05.793552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:05.793880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:05.795303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.805646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 240/448] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:05.806184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.833031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3e4b2-9a21-4d7c-a8ec-38b2af01315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:05.833975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3e4b2-9a21-4d7c-a8ec-38b2af01315a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:05.834336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3e4b2-9a21-4d7c-a8ec-38b2af01315a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:05.834642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3e4b2-9a21-4d7c-a8ec-38b2af01315a None admin] PATH_INFO: `/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:05.835999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3e4b2-9a21-4d7c-a8ec-38b2af01315a None admin] RBAC: Authorizing `identity:get_group(group_id=a5d164dec3bb46b7a4cabd5229a53c93)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:05.837859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3e4b2-9a21-4d7c-a8ec-38b2af01315a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.840212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 209/449] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/groups/a5d164dec3bb46b7a4cabd5229a53c93 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:05.841029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3e4b2-9a21-4d7c-a8ec-38b2af01315a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.895179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:05.927475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6582a4-b000-4627-a3fc-b410b064fe78 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:05.965847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:05.966497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:05.966779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:05.967093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:05.968335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] RBAC: Adding query filter params (group.id=a5d164dec3bb46b7a4cabd5229a53c93, role.id=bd70368fbbd7408eb37fc3ea32f7843e, scope.project.id=f289526ed98a4fe38c3ad61be0ecd099) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:05.968844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:05.971356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:05.979220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 241/450] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/role_assignments?group.id=a5d164dec3bb46b7a4cabd5229a53c93&scope.project.id=f289526ed98a4fe38c3ad61be0ecd099&role.id=bd70368fbbd7408eb37fc3ea32f7843e => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:05.980283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:05.989157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3e4b2-9a21-4d7c-a8ec-38b2af01315a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:06.007913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:06.038870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89367f61-e183-46ec-b95d-f3238cc8bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:06.039532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367f61-e183-46ec-b95d-f3238cc8bbd9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:06.039851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367f61-e183-46ec-b95d-f3238cc8bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:06.040083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89367f61-e183-46ec-b95d-f3238cc8bbd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:06.169273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89367f61-e183-46ec-b95d-f3238cc8bbd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:06.172065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89367f61-e183-46ec-b95d-f3238cc8bbd9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:06.178760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8858cc-9385-4308-9f87-8c019b124ce4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:06.230964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:06.232202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:06.232717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:06.233456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:06.236402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] RBAC: Adding query filter params (group.id=a5d164dec3bb46b7a4cabd5229a53c93, role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=05e3776e5294421c871d6041b669b876) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:06.236960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:06.240315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:06.244749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:06.253109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 242/451] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/role_assignments?group.id=a5d164dec3bb46b7a4cabd5229a53c93&scope.project.id=05e3776e5294421c871d6041b669b876&role.id=0adab6046ed34edf8914c4971198655f => generated 611 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:06.361167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 210/452] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:06.369222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:06.514427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53610fd-b667-460f-9cdf-f6ffe6cb3947 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:06.555029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e0d27-e312-4805-b77d-ae693b311e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:06.555795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0d27-e312-4805-b77d-ae693b311e07 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:06.556186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0d27-e312-4805-b77d-ae693b311e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:06.556611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0d27-e312-4805-b77d-ae693b311e07 None admin] PATH_INFO: `/v3/projects/71839b182c07466f9bb5d0732665873b` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:06.558522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e0d27-e312-4805-b77d-ae693b311e07 None admin] RBAC: Authorizing `identity:get_project(project_id=71839b182c07466f9bb5d0732665873b)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:06.560986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e0d27-e312-4805-b77d-ae693b311e07 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:06.563493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 243/453] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:35:06 2022] GET /identity/v3/projects/71839b182c07466f9bb5d0732665873b => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:06.570170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89367f61-e183-46ec-b95d-f3238cc8bbd9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:06.588315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:06.700194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89367f61-e183-46ec-b95d-f3238cc8bbd9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:06.739458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e57fdf-9f15-4c52-806f-412bbccaa029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:06.740116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e57fdf-9f15-4c52-806f-412bbccaa029 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:06.740391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e57fdf-9f15-4c52-806f-412bbccaa029 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:06.740665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e57fdf-9f15-4c52-806f-412bbccaa029 None admin] PATH_INFO: `/v3/groups/dd3db468e2e446baab4b56b3849495b9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:06.741882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e57fdf-9f15-4c52-806f-412bbccaa029 None admin] RBAC: Authorizing `identity:get_group(group_id=dd3db468e2e446baab4b56b3849495b9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:06.743355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e57fdf-9f15-4c52-806f-412bbccaa029 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:06.744966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 211/454] 10.222.0.30 () {56 vars in 1180 bytes} [Tue Oct 4 12:35:06 2022] GET /identity/v3/groups/dd3db468e2e446baab4b56b3849495b9 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:06.751319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e0d27-e312-4805-b77d-ae693b311e07 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:06.834852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:06.876030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e0d27-e312-4805-b77d-ae693b311e07 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:06.917163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24693ee7-6473-4e55-8ef6-eb406ad70a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:06.917829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693ee7-6473-4e55-8ef6-eb406ad70a61 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:06.918122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693ee7-6473-4e55-8ef6-eb406ad70a61 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:06.918401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693ee7-6473-4e55-8ef6-eb406ad70a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:06.919179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693ee7-6473-4e55-8ef6-eb406ad70a61 None admin] RBAC: Adding query filter params (group.id=dd3db468e2e446baab4b56b3849495b9, role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=71839b182c07466f9bb5d0732665873b) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:06.919495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693ee7-6473-4e55-8ef6-eb406ad70a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:06.921002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693ee7-6473-4e55-8ef6-eb406ad70a61 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:06.928315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 244/455] 10.222.0.30 () {56 vars in 1376 bytes} [Tue Oct 4 12:35:06 2022] GET /identity/v3/role_assignments?group.id=dd3db468e2e446baab4b56b3849495b9&scope.project.id=71839b182c07466f9bb5d0732665873b&role.id=b8bf66974c0448089a192ead432a35f2 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:09.541282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb16e82-725e-4ef6-8782-983919026a48 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:09.542864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb16e82-725e-4ef6-8782-983919026a48 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:09.543601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb16e82-725e-4ef6-8782-983919026a48 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:09.546434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 212/456] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:09.553674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1378db0-97c2-4bab-9d45-e696b71c4ca4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:09.555121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1378db0-97c2-4bab-9d45-e696b71c4ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:09.555879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1378db0-97c2-4bab-9d45-e696b71c4ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:09.593003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a1378db0-97c2-4bab-9d45-e696b71c4ca4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:09.595603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a1378db0-97c2-4bab-9d45-e696b71c4ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:09.760645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 245/457] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:09.777582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4a1e-37e6-405e-96b6-ce48b0ba11db None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:09.778895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4a1e-37e6-405e-96b6-ce48b0ba11db None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:09.779640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4a1e-37e6-405e-96b6-ce48b0ba11db None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:09.782419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 213/458] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:09.792161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb114f-fdf2-47b1-97b7-b03dd9460244 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:09.793093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb114f-fdf2-47b1-97b7-b03dd9460244 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:09.793876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb114f-fdf2-47b1-97b7-b03dd9460244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:09.839190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0cdb114f-fdf2-47b1-97b7-b03dd9460244 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:09.841555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0cdb114f-fdf2-47b1-97b7-b03dd9460244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:09.956990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:09.971386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 246/459] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:10.269868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0429-43bf-4d36-b493-ac49c940c807 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:10.270124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0429-43bf-4d36-b493-ac49c940c807 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:10.270511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd0429-43bf-4d36-b493-ac49c940c807 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:10.272061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 214/460] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:10.277398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c91ae2-963e-461b-b8a1-d8411b0d5c80 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:10.278024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c91ae2-963e-461b-b8a1-d8411b0d5c80 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:10.278308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c91ae2-963e-461b-b8a1-d8411b0d5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:10.302862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e2c91ae2-963e-461b-b8a1-d8411b0d5c80 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:10.304054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e2c91ae2-963e-461b-b8a1-d8411b0d5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:10.315819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0429-43bf-4d36-b493-ac49c940c807 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:10.455138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 247/461] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:10.480351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:10.511743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd0429-43bf-4d36-b493-ac49c940c807 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:10.570344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:10.571642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:10.572062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:10.572467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:10.593162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:10.594980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:10.600723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c91ae2-963e-461b-b8a1-d8411b0d5c80 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:10.617885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:10.618868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:10.619683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:10.619683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:10.619683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:10.621657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 215/462] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:10.659150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:10.830372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917d8af-2d1a-4261-a0e5-db271c62e420 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:10.865285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c91ae2-963e-461b-b8a1-d8411b0d5c80 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:10.896999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:10.906537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:10.907942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:10.908653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:10.909329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:10.910863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:10.913252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:10.914194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:10.916946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:10.939015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:10.940191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:10.940975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:10.941355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:10.941527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 216/463] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:10.943280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:10.963385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:10.966971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:10.998986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:11.000696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:11.002394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:11.002394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:11.002394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:11.013925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 248/464] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:11.016735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:11.138394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5b5e-21a5-4a80-9c04-ec36ce6f5971 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:11.205284 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:11.206957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:11.207609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:11.208056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:11.213834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25bad1-b2f2-44de-aeaa-1a46f0de8dfe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:11.228444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:11.231382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:11.261443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:11.263248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:11.264920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:11.264920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:11.264920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:11.264920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 217/465] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:11.266422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:11.291271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e0d9b-248f-4f03-ba27-948d457098fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:11.292775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0d9b-248f-4f03-ba27-948d457098fb None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:11.293553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0d9b-248f-4f03-ba27-948d457098fb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:11.294338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0d9b-248f-4f03-ba27-948d457098fb None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:11.296090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e0d9b-248f-4f03-ba27-948d457098fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:11.299313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e0d9b-248f-4f03-ba27-948d457098fb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:11.345805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 249/466] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:35:11 2022] POST /identity/v3/users => generated 246 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:35:11.348080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e0d9b-248f-4f03-ba27-948d457098fb None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:11.360864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:11.412812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:11.513225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c606e4e-67b7-40be-9d87-1254634ad98b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:11.597347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:11.598352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:11.598352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:11.598590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:11.599164 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:11.599464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:11.600915 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:11.630921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 218/467] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:11.635227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e0d9b-248f-4f03-ba27-948d457098fb None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:11.639359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:11.704714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:11.705237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:11.705518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:11.708482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:11.708482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:11.708482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:11.709849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:11.726806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 250/468] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:11.739056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:11.826948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4b2be-96fc-4d1c-b947-bfe76e437017 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:11.829812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:11.877526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cffc2c-9475-410a-9026-7eaa72497fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:11.878221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffc2c-9475-410a-9026-7eaa72497fef None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:11.879228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffc2c-9475-410a-9026-7eaa72497fef None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:11.879680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cffc2c-9475-410a-9026-7eaa72497fef None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:11.880835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cffc2c-9475-410a-9026-7eaa72497fef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:11.883939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cffc2c-9475-410a-9026-7eaa72497fef None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:11.917307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:11.931251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 219/469] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:35:11 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:35:11.948915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d953a7d-94e2-4f4c-b463-4c8981eb4683 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:12.024166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22c5c3-c986-4130-b718-5c7b26f30844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:12.025999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22c5c3-c986-4130-b718-5c7b26f30844 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:12.026782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22c5c3-c986-4130-b718-5c7b26f30844 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:12.027557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22c5c3-c986-4130-b718-5c7b26f30844 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:12.029422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22c5c3-c986-4130-b718-5c7b26f30844 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:12.032637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22c5c3-c986-4130-b718-5c7b26f30844 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:12.044397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12035f4-0c1e-4e86-a59e-d88c8c7b0319 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:12.044908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12035f4-0c1e-4e86-a59e-d88c8c7b0319 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:12.045425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12035f4-0c1e-4e86-a59e-d88c8c7b0319 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:12.048237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 220/470] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:12.062425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2fda-eb7e-4d0b-9ff0-9507ff12adb9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:12.063640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2fda-eb7e-4d0b-9ff0-9507ff12adb9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:12.064128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2fda-eb7e-4d0b-9ff0-9507ff12adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:12.069278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 251/471] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:35:11 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:35:12.106969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-551a2fda-eb7e-4d0b-9ff0-9507ff12adb9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:12.108556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-551a2fda-eb7e-4d0b-9ff0-9507ff12adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:12.212009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 221/472] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:12.339979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cbba-2494-4e9c-b501-c57f195d4f71 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:12.340855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cbba-2494-4e9c-b501-c57f195d4f71 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:12.341516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5cbba-2494-4e9c-b501-c57f195d4f71 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:12.344233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 252/473] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:12.352537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efef65-69c5-4a22-bef5-78300756486e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:12.353445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efef65-69c5-4a22-bef5-78300756486e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:12.354168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efef65-69c5-4a22-bef5-78300756486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:12.385491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e2efef65-69c5-4a22-bef5-78300756486e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:12.388008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e2efef65-69c5-4a22-bef5-78300756486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:12.503714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 222/474] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:12.531034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5cbba-2494-4e9c-b501-c57f195d4f71 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:12.722528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5cbba-2494-4e9c-b501-c57f195d4f71 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:12.763633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:12.764617 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:12.765281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:12.765748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:12.781557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:12.783357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:12.787433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:12.809558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:12.811311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:12.812921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:12.812921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:12.812921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:12.815475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 253/475] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:12.819459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efef65-69c5-4a22-bef5-78300756486e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:12.886688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:12.914176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:13.157721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efef65-69c5-4a22-bef5-78300756486e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:13.185261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4365-8202-40a3-b255-1eb654f176f4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:13.235837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:13.236459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:13.236802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:13.237005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:13.238217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:13.238520 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:13.240297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:13.267092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:13.268218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:13.269260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:13.269878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:13.271057 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:13.276531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 223/476] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:13.277286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:13.285625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:13.313519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.sql.core [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 12:35:13.313519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 12:35:13.313519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [parameters: {'id': '7079b943db6b40b4b46e50efea558016', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 12:35:13.313519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88339) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application conn.query(q) Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result.read() Oct 04 12:35:13.373697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 12:35:13.374661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application next(self.gen) Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application yield resource Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application next(self.gen) Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise self.value Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application session.commit() Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 12:35:13.375570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.session.flush() Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application compat.raise_( Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 12:35:13.376437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 12:35:13.377321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application conn.query(q) Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result.read() Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 12:35:13.378808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [parameters: {'id': '7079b943db6b40b4b46e50efea558016', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:13.380897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 12:35:13.382889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:13.388649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 254/477] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 4 12:35:12 2022] POST /identity/v3/roles => generated 144 bytes in 501 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:13.388819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:13.513978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:13.544136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485899a-ad4f-4efc-840f-e3a51b5b3b8f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:13.578217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:13.620694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24d0b-cfb0-4d35-b60c-6f34df3237d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:13.621255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24d0b-cfb0-4d35-b60c-6f34df3237d0 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:13.621532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24d0b-cfb0-4d35-b60c-6f34df3237d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:13.621830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24d0b-cfb0-4d35-b60c-6f34df3237d0 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:13.622552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24d0b-cfb0-4d35-b60c-6f34df3237d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:13.627379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24d0b-cfb0-4d35-b60c-6f34df3237d0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:13.668491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a87b4b-133f-4cfc-bdeb-117c89c9f3b9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:13.671787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 224/478] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:35:13 2022] POST /identity/v3/users => generated 249 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:35:13.745654 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f9134-fe13-447c-9be0-f9e8c9d00c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:13.746342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9134-fe13-447c-9be0-f9e8c9d00c2b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:13.746658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9134-fe13-447c-9be0-f9e8c9d00c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:13.746878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f9134-fe13-447c-9be0-f9e8c9d00c2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:13.765180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f9134-fe13-447c-9be0-f9e8c9d00c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-337f9134-fe13-447c-9be0-f9e8c9d00c2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:13.771622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:13.773309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:13.774882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 255/479] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:35:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:13.787402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24d0b-cfb0-4d35-b60c-6f34df3237d0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:14.006429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24d0b-cfb0-4d35-b60c-6f34df3237d0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:14.059890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be79c93-6985-487a-a5a8-f0ba0e835399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:14.060519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79c93-6985-487a-a5a8-f0ba0e835399 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:14.060796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79c93-6985-487a-a5a8-f0ba0e835399 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:14.061076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be79c93-6985-487a-a5a8-f0ba0e835399 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:14.065428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be79c93-6985-487a-a5a8-f0ba0e835399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:14.065428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be79c93-6985-487a-a5a8-f0ba0e835399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:14.065428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be79c93-6985-487a-a5a8-f0ba0e835399 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:14.067065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:14.083478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 225/480] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:14.810911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76df5-0f63-489c-8be2-f8d42a001fde None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:14.811415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76df5-0f63-489c-8be2-f8d42a001fde None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:14.811786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76df5-0f63-489c-8be2-f8d42a001fde None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:14.814823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 256/481] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:14.823948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7885e5-5f76-4b63-9391-93537c97db54 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:14.824451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7885e5-5f76-4b63-9391-93537c97db54 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:14.824934 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7885e5-5f76-4b63-9391-93537c97db54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:14.856089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ba7885e5-5f76-4b63-9391-93537c97db54 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:14.858169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ba7885e5-5f76-4b63-9391-93537c97db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:15.007537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 226/482] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:15.706673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e76df5-0f63-489c-8be2-f8d42a001fde None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:15.935878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e76df5-0f63-489c-8be2-f8d42a001fde None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:15.958460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890452ad-0aba-490f-a891-d43927658221 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:15.958910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890452ad-0aba-490f-a891-d43927658221 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:15.959158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890452ad-0aba-490f-a891-d43927658221 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:15.960841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 227/483] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:35:15.967554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f8578-1488-44a9-b805-fb23018cac87 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:15.968045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f8578-1488-44a9-b805-fb23018cac87 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:15.968499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f8578-1488-44a9-b805-fb23018cac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:15.985935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:16.020366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e71f8578-1488-44a9-b805-fb23018cac87 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:16.025395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e71f8578-1488-44a9-b805-fb23018cac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:16.034504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ad247-983d-46e8-94cb-5c5019c7474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:16.036957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ad247-983d-46e8-94cb-5c5019c7474b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:16.037455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ad247-983d-46e8-94cb-5c5019c7474b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:16.037980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ad247-983d-46e8-94cb-5c5019c7474b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:16.086160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ad247-983d-46e8-94cb-5c5019c7474b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e27ad247-983d-46e8-94cb-5c5019c7474b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:16.099039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:16.100106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:16.100924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 257/484] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:16.118535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ad247-983d-46e8-94cb-5c5019c7474b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:16.257125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 228/485] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:16.262448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db855b-2fd8-4b91-a741-35d162848b9d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:16.262951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db855b-2fd8-4b91-a741-35d162848b9d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:16.263369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db855b-2fd8-4b91-a741-35d162848b9d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:16.265914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 229/486] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:16.282527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f82cb-db40-4909-9c6b-e2dff7a487db None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:16.282935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f82cb-db40-4909-9c6b-e2dff7a487db None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:16.283353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f82cb-db40-4909-9c6b-e2dff7a487db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:16.338499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-434f82cb-db40-4909-9c6b-e2dff7a487db None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:16.343119 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-434f82cb-db40-4909-9c6b-e2dff7a487db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:16.423122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ad247-983d-46e8-94cb-5c5019c7474b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:16.494781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:16.495826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:16.496313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:16.496792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:16.498069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:16.498558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:16.506798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:16.531672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:16.543522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 258/487] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:16.563131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:16.579370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 230/488] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:16.580288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f82cb-db40-4909-9c6b-e2dff7a487db None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:16.706373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:16.846511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ee6b5-0bf9-496b-be75-ee6e28e45709 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:16.876665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f82cb-db40-4909-9c6b-e2dff7a487db None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:16.921770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48595d2a-a3df-4a31-ba97-d919a6bf7c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:16.922429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595d2a-a3df-4a31-ba97-d919a6bf7c59 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:16.922711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595d2a-a3df-4a31-ba97-d919a6bf7c59 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:16.922990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48595d2a-a3df-4a31-ba97-d919a6bf7c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:16.935835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48595d2a-a3df-4a31-ba97-d919a6bf7c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:16.937323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48595d2a-a3df-4a31-ba97-d919a6bf7c59 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:16.938533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13a1f5-94c1-4a7f-a5ae-9dcf82d5748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:16.939373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a1f5-94c1-4a7f-a5ae-9dcf82d5748b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:16.939927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a1f5-94c1-4a7f-a5ae-9dcf82d5748b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:16.940349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a1f5-94c1-4a7f-a5ae-9dcf82d5748b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:16.954280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13a1f5-94c1-4a7f-a5ae-9dcf82d5748b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-48595d2a-a3df-4a31-ba97-d919a6bf7c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:16.954987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:16.956675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:16.958299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:16.958299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:16.958299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:16.958299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 259/489] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:16.959740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6594-02e2-4cd8-9137-abb84c17ac3e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:16.960053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6594-02e2-4cd8-9137-abb84c17ac3e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:16.960539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6594-02e2-4cd8-9137-abb84c17ac3e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:16.966318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 260/490] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:16.966318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6594-02e2-4cd8-9137-abb84c17ac3e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6b13a1f5-94c1-4a7f-a5ae-9dcf82d5748b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:16.969639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:16.970646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:16.971443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:16.974845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 231/491] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:16.977902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703d42-1af9-42b7-b5ff-d27a3ab66de6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:16.978349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703d42-1af9-42b7-b5ff-d27a3ab66de6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:16.978768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703d42-1af9-42b7-b5ff-d27a3ab66de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.002540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e3703d42-1af9-42b7-b5ff-d27a3ab66de6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:17.004409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e3703d42-1af9-42b7-b5ff-d27a3ab66de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:17.076006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:17.107068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 232/492] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:17.110193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:17.114377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3703d42-1af9-42b7-b5ff-d27a3ab66de6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.120951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6594-02e2-4cd8-9137-abb84c17ac3e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.162706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.163335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.163622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.163887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.164790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:17.165099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:17.166554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:17.185059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 261/493] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:17.186086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.304390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf60cf-4b44-4c9e-b311-7b8f08d02b8c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.311618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3703d42-1af9-42b7-b5ff-d27a3ab66de6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.343903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83942f-5596-4a5a-965d-62bc318dba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.344548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83942f-5596-4a5a-965d-62bc318dba4f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.344827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83942f-5596-4a5a-965d-62bc318dba4f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.345099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83942f-5596-4a5a-965d-62bc318dba4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.358863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83942f-5596-4a5a-965d-62bc318dba4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8a83942f-5596-4a5a-965d-62bc318dba4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:17.363907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:17.365696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 262/494] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:17.367303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83942f-5596-4a5a-965d-62bc318dba4f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.384976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:17.388719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.390531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.390995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.391454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.392276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:17.392586 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:17.394679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:17.408420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 233/495] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:17.408420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.451967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:17.519013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a36b3-7191-4590-b165-bf37c391b12d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.532704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83942f-5596-4a5a-965d-62bc318dba4f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.555695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.556321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.556599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.556868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.557573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:17.557912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:17.559351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:17.568828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 234/496] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:17.569734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.594615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.595320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.595689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.596039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.605181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:17.606986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:17.623193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:17.624157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:17.625092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:17.626352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 263/497] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:17.627163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.691779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb028f3-f739-4e3c-b6a1-8d368d583633 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.693392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:17.715740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:17.732270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacb531-47f9-49f6-8716-6ea371368d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.732899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb531-47f9-49f6-8716-6ea371368d43 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.733187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb531-47f9-49f6-8716-6ea371368d43 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.733457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb531-47f9-49f6-8716-6ea371368d43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.742365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbb05e-35ce-449d-83b2-0a0507c55b3f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.744771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacb531-47f9-49f6-8716-6ea371368d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-0cacb531-47f9-49f6-8716-6ea371368d43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:17.750175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:17.751730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 235/498] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:17.754073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47061-d436-48d3-9748-5a82299663af None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.757107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47061-d436-48d3-9748-5a82299663af None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.757107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c47061-d436-48d3-9748-5a82299663af None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.757107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 236/499] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:17.757107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47061-d436-48d3-9748-5a82299663af None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.783881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.784542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.784820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.785089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.796571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:17.798103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:17.814446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:17.816153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:17.817103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:17.817103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:17.817103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:17.817103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 264/500] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:17.817103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.889417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c47061-d436-48d3-9748-5a82299663af None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.928268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.929077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.929457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.929858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.941174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b5124-2089-43d4-9267-aa18c61ab439 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:17.942399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:17.944359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:17.963764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:17.965015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:17.966640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:17.966640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:17.966640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:17.966640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 237/501] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:17.966640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:17.978558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:17.983178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:17.992280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd207c1e-3940-4a12-8960-8c2b13b449ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:17.993233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207c1e-3940-4a12-8960-8c2b13b449ba None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:17.993724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207c1e-3940-4a12-8960-8c2b13b449ba None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:17.994126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd207c1e-3940-4a12-8960-8c2b13b449ba None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:17.995361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd207c1e-3940-4a12-8960-8c2b13b449ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:17.995856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd207c1e-3940-4a12-8960-8c2b13b449ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:17.998366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd207c1e-3940-4a12-8960-8c2b13b449ba None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:18.057172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 265/502] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:18.058595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e6ec-248e-4a67-8d4a-419971af4a3e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:18.058886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e6ec-248e-4a67-8d4a-419971af4a3e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:18.059169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e6ec-248e-4a67-8d4a-419971af4a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:18.077359 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e1a2e6ec-248e-4a67-8d4a-419971af4a3e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:18.078605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e1a2e6ec-248e-4a67-8d4a-419971af4a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:18.097340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db996865-d9ec-4df0-823e-f7bc596ff2e3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:18.133865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:18.134479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:18.134763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:18.135041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:18.135714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:18.136019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:18.137415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:18.146005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 238/503] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:18.146789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:18.152945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 266/504] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:18.154062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e6ec-248e-4a67-8d4a-419971af4a3e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:18.250876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:18.279761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4db8db-f3c3-450a-b8ed-08083b834c2a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:18.302924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e6ec-248e-4a67-8d4a-419971af4a3e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:18.319451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:18.320057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:18.320341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:18.320613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:18.321261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:18.321555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:18.322455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:18.322955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:18.337320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 239/505] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:18.344709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:18.365052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:18.366217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:18.366822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:18.367305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:18.368437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:18.368954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:18.372846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:18.397079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 267/506] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:18.399139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:18.477157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259256ee-5907-4995-bc75-fbc1bbd2bee8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:18.518107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02835-4767-46b4-a86e-954f10793beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:18.519411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02835-4767-46b4-a86e-954f10793beb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:18.519780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02835-4767-46b4-a86e-954f10793beb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:18.520156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c02835-4767-46b4-a86e-954f10793beb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:18.524948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:18.548788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303825c-dc9e-41c2-b322-6ce1804b6ecc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:18.591924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:18.592571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:18.592852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:18.593125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:18.599698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c02835-4767-46b4-a86e-954f10793beb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:18.601323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c02835-4767-46b4-a86e-954f10793beb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:18.605953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:18.607436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:18.623052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:18.625075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:18.627023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:18.627023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:18.627023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:18.627023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 268/507] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:18.627023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:18.660367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:18.738955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 240/508] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:18.739827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02835-4767-46b4-a86e-954f10793beb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:18.779298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:18.790651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffebd9-6934-4b9e-843d-33e11d446ba6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:18.842414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:18.843510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:18.844002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:18.844471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:18.859729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:18.863561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:18.865911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c02835-4767-46b4-a86e-954f10793beb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:18.878171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:18.880190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 269/509] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:18.881967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:18.914214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:18.915007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:18.915407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:18.915843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:18.926271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:18.928026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:18.943324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:18.945132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 241/510] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:18.947717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.017893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:19.035330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73aaabf-24c5-484d-b477-8021c3c445b1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.072746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:19.073409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:19.073718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:19.073992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:19.086962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:19.088498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:19.091658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:19.102760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537d34-e06d-4441-b880-f6ff644510ae None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:19.106294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:19.107986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:19.109516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:19.109516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:19.109516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:19.109516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 270/511] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:19.109516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.149706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:19.150322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:19.150599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:19.150873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:19.151523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:19.151824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:19.153501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:19.167854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 242/512] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:19.168726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.273826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d8a41-bf26-4529-a88d-ea1d5035e765 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.289227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44b98d-b662-4d44-a894-5d0fe4cb3fa6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.316932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:19.317756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:19.318125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:19.318504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:19.326361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:19.332150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:19.333035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:19.333487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:19.333961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:19.334166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:19.335085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:19.335590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:19.337232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:19.338054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:19.361836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:19.363450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:19.365025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:19.365025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:19.365025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:19.365764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 271/513] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:19.366991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.395031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 243/514] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 4 12:35:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:19.396384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.424404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:19.515996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ac432-4d3f-4efc-b20f-f3e55ce1a34d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.550423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1f523-f9be-4f55-8c23-4e6f737ef1a5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.558703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:19.559646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:19.560114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:19.560614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:19.561903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:19.562412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:19.564754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:19.589690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 272/515] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 4 12:35:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:19.590691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.605548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:19.606542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:19.607003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:19.607453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:19.608462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:19.608925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:19.611303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:19.636068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 244/516] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:19.636068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.671183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:19.732669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:19.750328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c61f-efc9-41e3-a8a4-f0d9a78cd5be None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.773835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7c1d0-ccd8-4460-af9d-1d2712cc6cc5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.808461 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:19.809225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:19.809585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:19.810059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:19.819854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:19.821663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:19.824082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:19.824696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:19.825150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:19.825580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:19.826417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:19.826786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:19.828292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:19.836887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:19.846135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 273/517] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:19.848425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.849656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 245/518] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:19.849656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:19.973497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749952ec-af6e-4fa0-9400-282efd1813dd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:19.985416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:20.004554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882d22d-08d3-414f-ac62-24ea8c171d9b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:20.016476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce384-fab6-406f-aa34-0d6d3a24ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:20.017085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce384-fab6-406f-aa34-0d6d3a24ae66 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:20.017363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce384-fab6-406f-aa34-0d6d3a24ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:20.017664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce384-fab6-406f-aa34-0d6d3a24ae66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:20.045541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade2b0-95cd-4af8-b36f-af18a7eb0753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:20.046604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade2b0-95cd-4af8-b36f-af18a7eb0753 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:20.047103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade2b0-95cd-4af8-b36f-af18a7eb0753 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:20.047594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade2b0-95cd-4af8-b36f-af18a7eb0753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:20.052261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:20.117331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ce384-fab6-406f-aa34-0d6d3a24ae66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:20.120313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ce384-fab6-406f-aa34-0d6d3a24ae66 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:20.128837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ade2b0-95cd-4af8-b36f-af18a7eb0753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:20.130468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ade2b0-95cd-4af8-b36f-af18a7eb0753 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:20.241303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 246/519] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:20.242463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade2b0-95cd-4af8-b36f-af18a7eb0753 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:20.278053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 274/520] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:20.285260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce384-fab6-406f-aa34-0d6d3a24ae66 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:20.286516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:20.299852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:20.369533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade2b0-95cd-4af8-b36f-af18a7eb0753 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:20.415862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce384-fab6-406f-aa34-0d6d3a24ae66 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:20.417750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3786953-fb46-45de-9c91-831b05db7eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:20.419561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3786953-fb46-45de-9c91-831b05db7eac None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:20.419561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3786953-fb46-45de-9c91-831b05db7eac None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:20.420878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3786953-fb46-45de-9c91-831b05db7eac None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:20.422027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3786953-fb46-45de-9c91-831b05db7eac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:20.424589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3786953-fb46-45de-9c91-831b05db7eac None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:20.454975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 247/521] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:35:20 2022] POST /identity/v3/users => generated 247 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:35:20.456903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3786953-fb46-45de-9c91-831b05db7eac None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:20.481549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:20.482686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:20.483178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:20.483675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:20.485159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:20.485765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:20.489088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:20.522304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 275/522] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Oct 4 12:35:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:20.523747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:20.614335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:20.633728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3786953-fb46-45de-9c91-831b05db7eac None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:20.655898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:20.696293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:20.697404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:20.697950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:20.698451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:20.701996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804bc56-5e7b-4662-92b9-58d16bd4237b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:20.712606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:20.715564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:20.740114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:20.742019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:20.744540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 248/523] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:20.745481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:20.749267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:20.750318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:20.750747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:20.751188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:20.764863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:20.766816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:20.789257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:20.791316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:20.793135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:20.793135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:20.793135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:20.793135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 276/524] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:20.793135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:20.904628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6210-9b33-4024-9aca-8bc486c96172 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:20.960806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f46f7-762c-4e1a-bc8b-232210b90506 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:20.964164 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:20.964811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:20.965090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:20.965365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:20.978241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:20.979726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:20.996427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:20.998220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:21.000836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:21.000836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:21.000836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:21.001375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:21.001702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 249/525] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:21.001702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:21.008914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:21.026778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233cf45-a56a-41ef-ad23-f0602b2d6e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:21.027498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233cf45-a56a-41ef-ad23-f0602b2d6e83 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:21.028108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233cf45-a56a-41ef-ad23-f0602b2d6e83 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:21.028437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233cf45-a56a-41ef-ad23-f0602b2d6e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:21.114296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233cf45-a56a-41ef-ad23-f0602b2d6e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:21.116962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233cf45-a56a-41ef-ad23-f0602b2d6e83 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:21.163935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d84bb-d424-436f-8287-d66c9b674f38 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:21.220509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:21.222162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:21.222622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:21.223120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:21.224476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:21.225036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:21.227959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:21.265765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 250/526] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:21.265765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:21.293435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 277/527] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:21.293435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233cf45-a56a-41ef-ad23-f0602b2d6e83 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:21.325628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:21.386833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:21.455503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a83c-3f38-4116-8c76-13dfac317e91 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:21.459633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233cf45-a56a-41ef-ad23-f0602b2d6e83 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:21.503963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:21.504578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:21.504963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:21.505239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:21.505927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:21.506340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:21.507737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:21.519974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:21.521023 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:21.521393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:21.528933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:21.529153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 278/528] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:21.529153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:21.529432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:21.529432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:21.529432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:21.549582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 251/529] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:21.551294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:21.656070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:21.686376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da95c7-a08c-42ca-b3df-94e175748406 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:21.712957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e668a5-8425-416c-bff6-a8fc908a734e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:21.727679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:21.728297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:21.728574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:21.728842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:21.729581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=175bb8ec9ccf487bb6e11f37bec82cb5) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:21.729917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:21.731376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:21.740144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 279/530] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:21 2022] GET /identity/v3/role_assignments?user.id=175bb8ec9ccf487bb6e11f37bec82cb5&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:21.741783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:21.766030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:21.781509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:21.783010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:21.783813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:21.785202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:21.799937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:21.801830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:21.818416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:21.819359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:21.820179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:21.820179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:21.820179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:21.822477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 252/531] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:21.823650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:21.952390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e331fc-10a3-47eb-9058-143da42e8349 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:21.958631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a97fe-727e-4221-a2f3-304eaec2d04d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:21.999058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:22.000740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:22.001265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:22.001770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:22.011735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:22.014159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:22.029425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:22.029821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:22.030632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:22.031443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:22.031443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:22.031443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:22.031443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:22.031443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:22.031443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:22.031443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:22.031443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:22.031836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:22.031836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:22.032579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:22.034252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 253/532] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:22.035385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:22.055300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:22.058538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:22.086013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:22.086920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:22.087729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:22.087729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:22.087729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:22.087729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:22.087729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:22.087729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:22.087729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:22.087729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:22.088268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 280/533] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:22.089943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:22.091139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:22.096027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:22.219391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64c71b-e5db-425a-b9de-302b4248c25f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:22.262798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a57338-8445-402f-8246-6b9192f32f3e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:22.306947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:22.308204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:22.308931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:22.309062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:22.309351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:22.309981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:22.310238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:22.310500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:22.311304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:22.311969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:22.312238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:22.314161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:22.315034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:22.318588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:22.341983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 281/534] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:22.342417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 254/535] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:22.342908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:22.345487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:22.448033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:22.497064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25345f-e3a9-4bc1-8e8e-b14179bba158 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:22.497589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:22.507654 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc574c8-44e6-49e6-859d-3be4e751d720 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:22.539887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:22.540949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:22.541430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:22.541934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:22.542841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:22.543467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:22.545798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:22.554773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:22.555399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:22.555681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:22.555958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:22.556706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=d75de5eca91b46daaffd3bd79b69a6d6) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:22.557749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:22.562140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:22.567421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 255/536] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:22 2022] GET /identity/v3/role_assignments?user.id=d75de5eca91b46daaffd3bd79b69a6d6&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:22.573735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 282/537] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:22.573934 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:22.581806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:22.789449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15aada0-7b04-48ae-872a-dbd829a3115a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:22.800437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6603a-6ae4-43a3-ba0f-09c60a8c744d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:22.853416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:22.856758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf43654-acac-4e4a-a634-40c1472946b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:22.857411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43654-acac-4e4a-a634-40c1472946b2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:22.857725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43654-acac-4e4a-a634-40c1472946b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:22.858002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf43654-acac-4e4a-a634-40c1472946b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:22.867054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf43654-acac-4e4a-a634-40c1472946b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:22.868595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:22.868729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf43654-acac-4e4a-a634-40c1472946b2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:22.869858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:22.870368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:22.870992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:22.872243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=cdb8a57a383c475caff51c3d6d5c6a47) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:22.872790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:22.874774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:22.883581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 283/538] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:22 2022] GET /identity/v3/role_assignments?user.id=cdb8a57a383c475caff51c3d6d5c6a47&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-dbf43654-acac-4e4a-a634-40c1472946b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:22.899637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:22.900566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:22.901402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:22.901402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:22.901402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:22.901402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:22.901402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:22.901402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:22.901402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:22.901402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:22.906103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 256/539] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:22.907469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:23.108042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e942-f2fe-4448-996c-bb6c3c072db0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:23.157986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100d3cb-3852-412a-9ff1-5e6c329bd56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:23.158622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d3cb-3852-412a-9ff1-5e6c329bd56f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:23.158911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d3cb-3852-412a-9ff1-5e6c329bd56f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:23.159208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d3cb-3852-412a-9ff1-5e6c329bd56f None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:23.159935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100d3cb-3852-412a-9ff1-5e6c329bd56f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:23.160241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100d3cb-3852-412a-9ff1-5e6c329bd56f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:23.161784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100d3cb-3852-412a-9ff1-5e6c329bd56f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:23.174512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1db7-fcdd-473f-9019-b2dcb6137948 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:23.174969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1db7-fcdd-473f-9019-b2dcb6137948 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:23.175415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a1db7-fcdd-473f-9019-b2dcb6137948 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:23.181157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 284/540] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:23.181398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 257/541] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:23.191481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73eedb-4ccc-45cb-ba3b-18e974f37623 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:23.191985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73eedb-4ccc-45cb-ba3b-18e974f37623 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:23.192465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73eedb-4ccc-45cb-ba3b-18e974f37623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:23.195301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a1db7-fcdd-473f-9019-b2dcb6137948 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:23.227271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6d73eedb-4ccc-45cb-ba3b-18e974f37623 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:23.229286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6d73eedb-4ccc-45cb-ba3b-18e974f37623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:23.246352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:23.334011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:23.425512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 285/542] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:23.492016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a1db7-fcdd-473f-9019-b2dcb6137948 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:23.542978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:23.543599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:23.543878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:23.544151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:23.545015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=3e1d9844633a4afaacbb1867b8bbe582) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:23.545329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:23.546841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:23.557767 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 258/543] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:23 2022] GET /identity/v3/role_assignments?user.id=3e1d9844633a4afaacbb1867b8bbe582&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 259 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:23.882312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73eedb-4ccc-45cb-ba3b-18e974f37623 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:24.002566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73eedb-4ccc-45cb-ba3b-18e974f37623 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:24.047342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60025e-7561-4585-ac86-afa525ea175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:24.048003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60025e-7561-4585-ac86-afa525ea175b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:24.048280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60025e-7561-4585-ac86-afa525ea175b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:24.048547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60025e-7561-4585-ac86-afa525ea175b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:24.060980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60025e-7561-4585-ac86-afa525ea175b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0d60025e-7561-4585-ac86-afa525ea175b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:24.070408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:24.072120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:24.074304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 286/544] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:24.086773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:24.258200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:24.282624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b14923-334c-46bc-8db2-cff3ca9f12d9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:24.326298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:24.326922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:24.327235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:24.327480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:24.328149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:24.328451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:24.329896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:24.345378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 259/545] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:24.352929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60025e-7561-4585-ac86-afa525ea175b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:24.404505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:24.533137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60025e-7561-4585-ac86-afa525ea175b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:24.590429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:24.591087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:24.591367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:24.591641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:24.607961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:24.609473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:24.633194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:24.634207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:24.635026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:24.635026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:24.635026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:24.635705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 287/546] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:24.641240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:24.868949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265dc1f-ca32-44b3-8843-bcb83c09a5c1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:24.936384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:24.937513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:24.938063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:24.938572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:24.939832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:24.940442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:24.943220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:24.968089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 260/547] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:24.975041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:25.190313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:25.224964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e6554-18c1-4620-84a3-4144ed23967a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:25.291301 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a41a96-90d9-41bd-ab8f-44bfcf85381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:25.292360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a41a96-90d9-41bd-ab8f-44bfcf85381e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:25.292828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a41a96-90d9-41bd-ab8f-44bfcf85381e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:25.293353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a41a96-90d9-41bd-ab8f-44bfcf85381e None admin] PATH_INFO: `/v3/users/swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:25.316403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a41a96-90d9-41bd-ab8f-44bfcf85381e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:25.318521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a41a96-90d9-41bd-ab8f-44bfcf85381e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a6a41a96-90d9-41bd-ab8f-44bfcf85381e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:25.337145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:25.338314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:25.339188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 288/548] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:25.345019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:25.359576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:25.412836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbbf94-f97d-4645-ad9b-318aee7eab93 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:25.413357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbbf94-f97d-4645-ad9b-318aee7eab93 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:25.413804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbbf94-f97d-4645-ad9b-318aee7eab93 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:25.416240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 289/549] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:25.437311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ee44e-6cda-4b4e-91ce-4fd20334e81e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:25.437830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ee44e-6cda-4b4e-91ce-4fd20334e81e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:25.438309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ee44e-6cda-4b4e-91ce-4fd20334e81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:25.480507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7f1ee44e-6cda-4b4e-91ce-4fd20334e81e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:25.482434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7f1ee44e-6cda-4b4e-91ce-4fd20334e81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:25.634322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ca881-6642-4813-bee2-dc38b2bc55a9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:25.652771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 290/550] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:25.692589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6dbd-1383-4720-b977-9c5c58b9323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:25.693401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6dbd-1383-4720-b977-9c5c58b9323d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:25.693929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6dbd-1383-4720-b977-9c5c58b9323d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:25.694250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6dbd-1383-4720-b977-9c5c58b9323d None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:25.695004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6dbd-1383-4720-b977-9c5c58b9323d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:25.695313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6dbd-1383-4720-b977-9c5c58b9323d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:25.696952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6dbd-1383-4720-b977-9c5c58b9323d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:25.720868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 261/551] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 4 12:35:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:25.726726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ee44e-6cda-4b4e-91ce-4fd20334e81e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:25.806646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6667-ab91-4dbb-a222-b225461437ad None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:25.807467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6667-ab91-4dbb-a222-b225461437ad None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:25.807749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6667-ab91-4dbb-a222-b225461437ad None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:25.809884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 262/552] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:35:25.818639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a4ad-eabb-460b-8af1-efb181a941e2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:25.819052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a4ad-eabb-460b-8af1-efb181a941e2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:25.819323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a4ad-eabb-460b-8af1-efb181a941e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:25.847322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2062a4ad-eabb-460b-8af1-efb181a941e2 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:25.849436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2062a4ad-eabb-460b-8af1-efb181a941e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:25.866898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:25.922236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ee44e-6cda-4b4e-91ce-4fd20334e81e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:25.957988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:25.968028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 263/553] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:26.013037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae3117-c85b-4f54-8b46-89ff7bafbb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:26.013708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae3117-c85b-4f54-8b46-89ff7bafbb4b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.013996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae3117-c85b-4f54-8b46-89ff7bafbb4b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.014261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae3117-c85b-4f54-8b46-89ff7bafbb4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.040892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a4ad-eabb-460b-8af1-efb181a941e2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:26.135988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae3117-c85b-4f54-8b46-89ff7bafbb4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:26.138035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae3117-c85b-4f54-8b46-89ff7bafbb4b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:26.202176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a4ad-eabb-460b-8af1-efb181a941e2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:26.244122 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200278-9c00-435e-a7a4-c8c80a9889d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:26.244911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200278-9c00-435e-a7a4-c8c80a9889d6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.245261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200278-9c00-435e-a7a4-c8c80a9889d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.245626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200278-9c00-435e-a7a4-c8c80a9889d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.246276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:26.257699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c200278-9c00-435e-a7a4-c8c80a9889d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-4c200278-9c00-435e-a7a4-c8c80a9889d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:26.262905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:26.263872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:26.264673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 264/554] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:26.269648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013c6-fbd5-4ee3-b5df-36551e1e1439 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.269648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013c6-fbd5-4ee3-b5df-36551e1e1439 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.269648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013c6-fbd5-4ee3-b5df-36551e1e1439 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.272396 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 265/555] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:26.273428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc013c6-fbd5-4ee3-b5df-36551e1e1439 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:26.274451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 291/556] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:26.275801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f303-3a72-451e-a9b8-a5b06e611d8f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.276086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f303-3a72-451e-a9b8-a5b06e611d8f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.276363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826f303-3a72-451e-a9b8-a5b06e611d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.298283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7826f303-3a72-451e-a9b8-a5b06e611d8f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:26.299593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7826f303-3a72-451e-a9b8-a5b06e611d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:26.334872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:26.395565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc013c6-fbd5-4ee3-b5df-36551e1e1439 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:26.413630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 292/557] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:26.413630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f303-3a72-451e-a9b8-a5b06e611d8f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:26.458881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:26.459771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.460059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.460334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.461094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:26.461407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:26.463460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:26.475179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 266/558] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:26.475807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:26.576779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826f303-3a72-451e-a9b8-a5b06e611d8f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:26.589289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:26.608798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ab8c6-0a54-4f9d-b71e-8cd26d074fbd None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:26.620330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:26.620982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.621266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.621536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.629904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:26.634582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:26.636584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:26.654936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:26.655950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:26.656799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:26.656799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:26.656799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:26.656799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 293/559] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:26.656799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:26.660709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572610-a5a7-48ed-8101-2b9a9aaa674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:26.661830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572610-a5a7-48ed-8101-2b9a9aaa674b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.662340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572610-a5a7-48ed-8101-2b9a9aaa674b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.662817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a572610-a5a7-48ed-8101-2b9a9aaa674b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.675629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a572610-a5a7-48ed-8101-2b9a9aaa674b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-9a572610-a5a7-48ed-8101-2b9a9aaa674b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:26.681875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:26.682795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:26.683644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:26.686437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 267/560] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:26.687704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572610-a5a7-48ed-8101-2b9a9aaa674b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:26.782986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c34134-9f58-4bc3-97d1-c3e9ebda4e4d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:26.837057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a572610-a5a7-48ed-8101-2b9a9aaa674b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:26.839255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:26.839910 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.840195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.840468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.854028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:26.855510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:26.871262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:26.873827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:26.875475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:26.875475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:26.875475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:26.875475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 294/561] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:26.875475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:26.894268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:26.899362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:26.899995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:26.900280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:26.900558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:26.901213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:26.901523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:26.903306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:26.925647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 268/562] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:26.926475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:26.969389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:26.996179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80632732-e21e-4b9e-a234-d69249258dd4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.031391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.032001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.032279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.032547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.033206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:27.033537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:27.035600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:27.044178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 295/563] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:27.045042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.063482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d776f5-43d9-4e8a-8908-6d324e23421f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.102987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417252f1-6ab8-4346-a3d0-25f34f3177a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.103623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417252f1-6ab8-4346-a3d0-25f34f3177a8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.103900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417252f1-6ab8-4346-a3d0-25f34f3177a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.104172 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417252f1-6ab8-4346-a3d0-25f34f3177a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.115402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417252f1-6ab8-4346-a3d0-25f34f3177a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-417252f1-6ab8-4346-a3d0-25f34f3177a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:27.120430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:27.121381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:27.122257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 269/564] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:27.122936 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b057c5-09f8-4288-9efb-80e5bc7bc587 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.123004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b057c5-09f8-4288-9efb-80e5bc7bc587 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.123293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b057c5-09f8-4288-9efb-80e5bc7bc587 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.124499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 270/565] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:27.125193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b057c5-09f8-4288-9efb-80e5bc7bc587 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.137951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:27.175574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e9209-5506-4cf4-b779-2d0e80d713dd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.214118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154297a-339b-498d-89db-05da86189a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.214643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154297a-339b-498d-89db-05da86189a54 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.214937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154297a-339b-498d-89db-05da86189a54 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.215206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154297a-339b-498d-89db-05da86189a54 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.215855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154297a-339b-498d-89db-05da86189a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:27.216151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154297a-339b-498d-89db-05da86189a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:27.217546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154297a-339b-498d-89db-05da86189a54 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:27.231011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 296/566] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:27.231875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154297a-339b-498d-89db-05da86189a54 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.240124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:27.250267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b057c5-09f8-4288-9efb-80e5bc7bc587 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.288461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9848-eca0-45bf-97f5-1ab5cee616c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.288829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9848-eca0-45bf-97f5-1ab5cee616c7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.289109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9848-eca0-45bf-97f5-1ab5cee616c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.289508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9848-eca0-45bf-97f5-1ab5cee616c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.296391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9848-eca0-45bf-97f5-1ab5cee616c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:27.297888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9848-eca0-45bf-97f5-1ab5cee616c7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-835b9848-eca0-45bf-97f5-1ab5cee616c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:27.309449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:27.310570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:27.311459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 271/567] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:27.311937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cc4b-6d42-4aa2-adac-04e03952fa9f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.312007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cc4b-6d42-4aa2-adac-04e03952fa9f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.312685 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cc4b-6d42-4aa2-adac-04e03952fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.330490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ddd8cc4b-6d42-4aa2-adac-04e03952fa9f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:27.332248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ddd8cc4b-6d42-4aa2-adac-04e03952fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:27.353752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154297a-339b-498d-89db-05da86189a54 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.398208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.399280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.399745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.400213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.404225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:27.413582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 272/568] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:27.414533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8cc4b-6d42-4aa2-adac-04e03952fa9f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.427134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:27.430140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:27.460726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:27.461805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:27.462705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:27.462705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:27.462705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:27.464306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 297/569] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:27.464805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.551697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:27.574047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8cc4b-6d42-4aa2-adac-04e03952fa9f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.629950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9464812-d907-4a8f-a97c-8b448020960c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.639756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.640742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.641196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.641684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.642835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:27.643434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:27.645637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:27.658886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 273/570] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:27.662235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.677234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.677926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.678210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.678484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.689097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:27.690684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:27.703517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:27.704574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 298/571] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:27.705498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.765553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:27.795201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d89dff-cc97-4682-91d4-0ebf4a7f2cf6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.827701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a0e22-ef03-4a44-a7e2-6c32cacf9416 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.838307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.839209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.839499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.839773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.840479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:27.840795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:27.842381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:27.857570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 274/572] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:27.859144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.870168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:27.870787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:27.871060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:27.871326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:27.871979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:27.872281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:27.872404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:27.873716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:27.886740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 299/573] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:27.887603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:27.981250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7def4-e3ef-477c-a845-8ac656be9ba2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:27.999625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d95cd-2e43-472c-be7e-fe0762a6b6a2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.008038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:28.025834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.026388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.026669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.026947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.039526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.041103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.042011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.042652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.042929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.043396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.044138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:28.044454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.045958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:28.057160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:28.058349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:28.059537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:28.059537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:28.059537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:28.059537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 275/574] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:28.059537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.066555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 300/575] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:35:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:28.068328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.131762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:28.182311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b72aa3-4fd2-44f1-8607-cb9d9a81bd07 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.183567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea088467-612a-4921-81b2-d9eab5cdfd39 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.219690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.220436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.220802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.221169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.222586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=a5f678debf35484989502439a8780ba1) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:28.222816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575539d-2ff1-4cf7-8b25-8055f8b58cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.223085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.223459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575539d-2ff1-4cf7-8b25-8055f8b58cad None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.223736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575539d-2ff1-4cf7-8b25-8055f8b58cad None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.224007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575539d-2ff1-4cf7-8b25-8055f8b58cad None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.224911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.232357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 301/576] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/role_assignments?user.id=a5f678debf35484989502439a8780ba1&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:28.233575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.236111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575539d-2ff1-4cf7-8b25-8055f8b58cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-7575539d-2ff1-4cf7-8b25-8055f8b58cad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:28.241799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:28.242886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 276/577] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:28.246521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575539d-2ff1-4cf7-8b25-8055f8b58cad None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.292011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:28.385787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575539d-2ff1-4cf7-8b25-8055f8b58cad None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.389232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a64e5a-ea60-44ca-9dee-50411b2bdb6c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.408760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:28.434383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.435025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.435292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.435568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.436232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:28.436544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.437998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.438346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.439501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.439930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.440887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.450832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.452349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 277/578] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:28.452806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.453342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:28.469481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:28.470701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 12:35:28.471885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:28.475633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 302/579] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:28.476639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.577952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb98943-62de-478a-be49-c6f7628dee11 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.583120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:28.596778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e940-7057-4a25-8ab0-633be54eae24 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.616746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.617389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.617698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.617979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.629963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.631451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.644040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.644850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.645223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.645501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.646435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:28.646742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.648318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:28.651445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:28.658260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:28.659534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:28.659534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:28.659534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:28.659534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 278/580] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:28.659534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.660108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 303/581] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:28.665569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.691088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:28.769246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97b930-153b-47cb-84f8-68a222e23b6d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.789643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e35a6-0f2e-414d-b4aa-74460feabad5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:28.806134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.806931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.807324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.807717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.816881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.818558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:28.831705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:28.833262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 279/582] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:28.840631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.844437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:28.845494 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:28.846294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:28.846858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:28.848143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:28.848737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:28.851242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:28.878715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 304/583] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:28.878715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:28.892560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:28.965653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:28.978748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054119d5-aca6-403e-9359-52d77eddf70c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.017820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3fc95-05a7-4fd3-82b6-0a699484e8b0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.020694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:29.021612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:29.022108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:29.022640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:29.023754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:29.024273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:29.026711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:29.049388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 280/584] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:29.049388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:29.071950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:29.072615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:29.072898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:29.073196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:29.086045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:29.087446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:29.104986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:29.106114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:29.106978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:29.106978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:29.106978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:29.106978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 305/585] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:29.106978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:29.207929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:29.224761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743bbd-8b15-44a9-bd1c-a946a38ffc73 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.259045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c01c1-1e74-4729-9306-b93a29c5c78a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.291112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:29.292266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:29.292849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:29.293440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:29.294873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:29.295448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:29.298217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:29.298845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:29.299678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:29.300131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:29.300545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:29.313804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:29.316200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:29.333626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 281/586] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 4 12:35:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:29.333890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:29.334935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:29.336011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:29.336011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:29.336011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:29.337056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:29.342278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 306/587] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:29.343788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:29.352850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:29.495645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6ed9c-d1bc-4e92-8331-72e23d237d02 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.520498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc59304-d945-4c36-b734-099624bf5895 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.536360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:29.537447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:29.537777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:29.538057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:29.544177 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:29.546004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:29.547455 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:29.561496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:29.563148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 282/588] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:29.566531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:29.595285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:29.596198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:29.596731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:29.597213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:29.598446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:29.599005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:29.601495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:29.626208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 307/589] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:29.627499 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:29.654895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:29.713167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747eda-6d3e-4768-b41a-4efa37fcfdbf None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.768954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:29.770002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:29.770374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:29.770801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:29.786276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:29.788858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:29.802899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd021-2c00-4a98-ba6e-ea7a09265314 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:29.813492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:29.816056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:29.818473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:29.818473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:29.818473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:29.818473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 283/590] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:29.818473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:29.867098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:29.868227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:29.868728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:29.869186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:29.870289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:29.870784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:29.873402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:29.893805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 308/591] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:29.894969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:29.931702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:29.967276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e64750-d9ce-4d4b-9044-ef79bf54ca06 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:29.997317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:30.015118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.015885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.016241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.016589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.017348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:30.017785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.019387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.024599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7491a-0d47-4b57-b097-444d6329d9f2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:30.043343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 284/592] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:30.043343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:30.071109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.071864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.072322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.072767 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.083586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.085966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:30.099916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:30.101793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 12:35:30.103680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:30.105730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 309/593] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:30.107020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:30.181005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0566e-71cb-458d-b84a-fc76d0ed986c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:30.218562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:30.229743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b922-604c-4c11-b56d-6ef9703d564b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:30.245956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.246985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.247484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.247990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.249197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:30.249771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.252772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.267805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.269083 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.269439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.269806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.279245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 285/594] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:30.279245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:30.280942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.282536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:30.300535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:30.301653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:30.302700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:30.302700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:30.302700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:30.302700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:30.302700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:30.302700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:30.302700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:30.302700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:30.303667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 310/595] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:30.304342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:30.347506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:30.429761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee907c-a41e-48d1-b247-f9d62ad5af87 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:30.433520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6b10a-da7a-4b7e-9051-02910d9d4a78 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:30.467884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edb43a-5cd3-4912-b0f2-4a9ecc303c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.468557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb43a-5cd3-4912-b0f2-4a9ecc303c88 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.468833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb43a-5cd3-4912-b0f2-4a9ecc303c88 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.469105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb43a-5cd3-4912-b0f2-4a9ecc303c88 None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/175bb8ec9ccf487bb6e11f37bec82cb5/roles/361ada32137e4db3aa12e6776e5789d7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.487806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edb43a-5cd3-4912-b0f2-4a9ecc303c88 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=175bb8ec9ccf487bb6e11f37bec82cb5, role_id=361ada32137e4db3aa12e6776e5789d7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.489278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edb43a-5cd3-4912-b0f2-4a9ecc303c88 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.490600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.491623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.492107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.492579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.494117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:30.494718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.497355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.505932 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 286/596] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:35:30 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/175bb8ec9ccf487bb6e11f37bec82cb5/roles/361ada32137e4db3aa12e6776e5789d7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:35:30.507391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edb43a-5cd3-4912-b0f2-4a9ecc303c88 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:30.527130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 311/597] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Oct 4 12:35:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:30.528970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:30.543046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:30.649582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec53a0-303f-4836-9ba8-6f51739505a2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:30.690653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.691186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.691533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.691811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.692916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:30.692916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.694372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.704907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:30.713646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 312/598] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:30.713646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:30.732191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edb43a-5cd3-4912-b0f2-4a9ecc303c88 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:30.800882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.802416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.804013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.804763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.824759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.829133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.833456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:30.854633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:30.856729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:30.858504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 287/599] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:30.864414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:30.887437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566002b-7157-46f3-95b2-3cf40d671777 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:30.941435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:30.942474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:30.942960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:30.943441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:30.964995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:30.967680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:30.996708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:30.998632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:31.007793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:31.007793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:31.007793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:31.007793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 313/600] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:31.007793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:31.019182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87d9e3-1b2b-43a2-b6ce-a199c090a6c5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:31.090640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dcc91-c9ce-481f-b059-be4ebcc57ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:31.092134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dcc91-c9ce-481f-b059-be4ebcc57ee0 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:31.092629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dcc91-c9ce-481f-b059-be4ebcc57ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:31.093124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dcc91-c9ce-481f-b059-be4ebcc57ee0 None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/d75de5eca91b46daaffd3bd79b69a6d6/roles/361ada32137e4db3aa12e6776e5789d7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:31.120362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dcc91-c9ce-481f-b059-be4ebcc57ee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=d75de5eca91b46daaffd3bd79b69a6d6, role_id=361ada32137e4db3aa12e6776e5789d7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:31.122637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dcc91-c9ce-481f-b059-be4ebcc57ee0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:31.138778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:31.147574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 288/601] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:35:30 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/d75de5eca91b46daaffd3bd79b69a6d6/roles/361ada32137e4db3aa12e6776e5789d7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:35:31.149512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c03ef-6a9b-4a2c-9ae0-b1ed297d5772 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:31.149825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c03ef-6a9b-4a2c-9ae0-b1ed297d5772 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:31.150103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c03ef-6a9b-4a2c-9ae0-b1ed297d5772 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:31.151677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 289/602] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:31.152185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c03ef-6a9b-4a2c-9ae0-b1ed297d5772 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:31.155155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf32df-e0e9-4b9d-9278-12bec67bebdd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:31.207618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:31.223492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f003de-51d2-4b42-97a7-5676b7488fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:31.224125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f003de-51d2-4b42-97a7-5676b7488fcd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:31.224407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f003de-51d2-4b42-97a7-5676b7488fcd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:31.224688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f003de-51d2-4b42-97a7-5676b7488fcd None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:31.225396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f003de-51d2-4b42-97a7-5676b7488fcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:31.225750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f003de-51d2-4b42-97a7-5676b7488fcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:31.227280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f003de-51d2-4b42-97a7-5676b7488fcd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:31.248350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 314/603] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:31.249953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d24e2-18a5-4a8b-a370-3a5659961d62 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:31.250296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d24e2-18a5-4a8b-a370-3a5659961d62 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:31.250544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d24e2-18a5-4a8b-a370-3a5659961d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:31.271464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-fb7d24e2-18a5-4a8b-a370-3a5659961d62 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:31.272742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fb7d24e2-18a5-4a8b-a370-3a5659961d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:31.348298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c03ef-6a9b-4a2c-9ae0-b1ed297d5772 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:31.400882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:31.402682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:31.403639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:31.404621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:31.413653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 315/604] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:31.413653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d24e2-18a5-4a8b-a370-3a5659961d62 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:31.414557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:31.415592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:31.419768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:31.458315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 290/605] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:31.467719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:31.540395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d24e2-18a5-4a8b-a370-3a5659961d62 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:31.556045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:31.583588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21aa7f-67f0-4caf-9032-419f5a532086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:31.584393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21aa7f-67f0-4caf-9032-419f5a532086 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:31.584687 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21aa7f-67f0-4caf-9032-419f5a532086 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:31.584983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21aa7f-67f0-4caf-9032-419f5a532086 None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/cdb8a57a383c475caff51c3d6d5c6a47/roles/361ada32137e4db3aa12e6776e5789d7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:31.603669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21aa7f-67f0-4caf-9032-419f5a532086 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=cdb8a57a383c475caff51c3d6d5c6a47, role_id=361ada32137e4db3aa12e6776e5789d7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:31.605345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21aa7f-67f0-4caf-9032-419f5a532086 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:31.608452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:31.630602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 316/606] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:35:31 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/cdb8a57a383c475caff51c3d6d5c6a47/roles/361ada32137e4db3aa12e6776e5789d7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:35:31.713770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c46a8-b0cc-43af-874b-6d3cf8f83eaa None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:31.794838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:31.796415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:31.797263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:31.798071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:31.819727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:31.823079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:31.848905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:31.850530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:31.852140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:31.852140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:31.852140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:31.852140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:31.852140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:31.852140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:31.852140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:31.852140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:31.856337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 291/607] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:31.865521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21aa7f-67f0-4caf-9032-419f5a532086 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:31.988240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21aa7f-67f0-4caf-9032-419f5a532086 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:32.028657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:32.029297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:32.029581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:32.029909 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:32.030615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:32.030923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:32.032413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:32.046682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 317/608] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:32.056865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:32.062437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:32.127478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:32.275291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633419ce-34de-415d-af66-9c8ae1c40a4a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:32.297745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:32.346810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980ebd7-7b39-44e1-804c-4636d0ea4324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:32.347892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ebd7-7b39-44e1-804c-4636d0ea4324 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:32.348356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ebd7-7b39-44e1-804c-4636d0ea4324 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:32.348803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ebd7-7b39-44e1-804c-4636d0ea4324 None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/3e1d9844633a4afaacbb1867b8bbe582/roles/361ada32137e4db3aa12e6776e5789d7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:32.379164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac131db4-bb98-4c90-ad8f-eec1ca8f42f9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:32.409361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980ebd7-7b39-44e1-804c-4636d0ea4324 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=3e1d9844633a4afaacbb1867b8bbe582, role_id=361ada32137e4db3aa12e6776e5789d7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:32.412569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980ebd7-7b39-44e1-804c-4636d0ea4324 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:32.455428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 292/609] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:35:32 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/3e1d9844633a4afaacbb1867b8bbe582/roles/361ada32137e4db3aa12e6776e5789d7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:35:32.484451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66188d-5de3-4fed-96c1-19210025c664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:32.485590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66188d-5de3-4fed-96c1-19210025c664 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:32.486274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66188d-5de3-4fed-96c1-19210025c664 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:32.486785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66188d-5de3-4fed-96c1-19210025c664 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:32.519696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66188d-5de3-4fed-96c1-19210025c664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-4a66188d-5de3-4fed-96c1-19210025c664 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:32.530227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:32.531194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:32.532007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:32.532653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 318/610] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:32.542752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980ebd7-7b39-44e1-804c-4636d0ea4324 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:32.776420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980ebd7-7b39-44e1-804c-4636d0ea4324 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:32.826507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:32.827043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:32.827334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:32.827609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:32.828307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:32.828617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:32.830216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:32.840500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 293/611] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:32.849585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66188d-5de3-4fed-96c1-19210025c664 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:33.040047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:33.088271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66188d-5de3-4fed-96c1-19210025c664 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:33.175805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:33.176771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:33.177217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:33.177699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:33.199178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:33.201889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:33.230065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:33.231851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:33.234438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:33.234438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:33.234438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:33.234438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 319/612] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:33.242795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:33.303389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:33.418828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb78a08-e884-47af-8c21-79c724851820 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:33.478988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:33.479620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:33.479903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:33.480184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:33.480841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:33.481150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:33.482630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:33.504719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 294/613] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:33.512896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:33.728313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6638-8d92-4247-8ac6-7feb78f443a1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:33.782922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:33.783593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:33.784426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:33.784707 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:33.791827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:33.799475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:33.802203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:33.821619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:33.823902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:33.826682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 320/614] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:33.829918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:34.038875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:34.049461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a345c-01e6-4474-8e35-672b1d4ca913 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:34.097145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:34.097826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:34.098111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:34.098385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:34.099179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:34.099489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:34.101036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:34.133674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 295/615] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 4 12:35:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:34.139644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:34.322716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a22046-43d9-4ffd-9c7f-2457b570cb40 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:34.412142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f0e1-af81-4060-a79e-bc4d75d3f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:34.413811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f0e1-af81-4060-a79e-bc4d75d3f079 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:34.414544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f0e1-af81-4060-a79e-bc4d75d3f079 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:34.415168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f0e1-af81-4060-a79e-bc4d75d3f079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:34.444454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f0e1-af81-4060-a79e-bc4d75d3f079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:34.447357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f0e1-af81-4060-a79e-bc4d75d3f079 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-1544f0e1-af81-4060-a79e-bc4d75d3f079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:34.488053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:34.489927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:34.492378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:34.492378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:34.492378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:34.492378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 321/616] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:34.496181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:34.697034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf11e3b-805f-4929-915e-f4a60977319f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:34.703533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e68f-9d90-4837-9379-7573059dbb18 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:34.704024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e68f-9d90-4837-9379-7573059dbb18 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:34.704498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4e68f-9d90-4837-9379-7573059dbb18 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:34.718444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 322/617] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:34 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:34.725953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4efa0-7f52-4100-b751-abf04f26bed0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:34.726558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4efa0-7f52-4100-b751-abf04f26bed0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:34.727033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4efa0-7f52-4100-b751-abf04f26bed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:34.759176 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-82e4efa0-7f52-4100-b751-abf04f26bed0 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:34.761440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-82e4efa0-7f52-4100-b751-abf04f26bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:34.769806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:34.770831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:34.771317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:34.771794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:34.773003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:34.773543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:34.785304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:34.824383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 296/618] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:34.831876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:34.866161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:34.871930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:34.917362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 323/619] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:35.087395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf404b8-1283-413d-bc90-e0d72c950694 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:35.154127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8421d79-6c5e-4367-ad4d-9c361e4d9024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:35.155517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8421d79-6c5e-4367-ad4d-9c361e4d9024 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:35.156329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8421d79-6c5e-4367-ad4d-9c361e4d9024 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:35.157019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8421d79-6c5e-4367-ad4d-9c361e4d9024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:35.171300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8421d79-6c5e-4367-ad4d-9c361e4d9024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:35.174541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8421d79-6c5e-4367-ad4d-9c361e4d9024 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c8421d79-6c5e-4367-ad4d-9c361e4d9024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:35.197788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:35.199777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:35.201740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:35.201740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:35.201740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:35.201740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:35.201740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:35.201740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:35.201740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:35.201740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:35.206501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 297/620] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:35.213671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4efa0-7f52-4100-b751-abf04f26bed0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:35.370083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7acf5-401f-47e7-8a39-6e0a39b63158 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:35.371181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7acf5-401f-47e7-8a39-6e0a39b63158 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:35.371930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7acf5-401f-47e7-8a39-6e0a39b63158 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:35.381045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 298/621] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:35:35.384828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226247-6db2-4651-8a9a-b66312107dd4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:35.385667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226247-6db2-4651-8a9a-b66312107dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:35.386401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226247-6db2-4651-8a9a-b66312107dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:35.410147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4efa0-7f52-4100-b751-abf04f26bed0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:35.419502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6f226247-6db2-4651-8a9a-b66312107dd4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:35.421781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6f226247-6db2-4651-8a9a-b66312107dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:35.474323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:35.475343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:35.475833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:35.476378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:35.477721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:35.478291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:35.485631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:35.505185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 324/622] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:35.516375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:35.589232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:35.595885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 299/623] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:35.597435 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226247-6db2-4651-8a9a-b66312107dd4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:35.623631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:35.852607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eb1a3-4103-4d3e-8e73-6c71d260a330 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:35.859803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226247-6db2-4651-8a9a-b66312107dd4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:35.933637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868e03-5f48-4d85-b083-b877cb461980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:35.934609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868e03-5f48-4d85-b083-b877cb461980 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:35.935102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868e03-5f48-4d85-b083-b877cb461980 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:35.935587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868e03-5f48-4d85-b083-b877cb461980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:35.968077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d22bf4-3544-469f-86e1-0636e0b1615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:35.969052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22bf4-3544-469f-86e1-0636e0b1615c None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:35.969457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22bf4-3544-469f-86e1-0636e0b1615c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:35.969902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22bf4-3544-469f-86e1-0636e0b1615c None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/a5f678debf35484989502439a8780ba1/roles/361ada32137e4db3aa12e6776e5789d7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:35.973735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87868e03-5f48-4d85-b083-b877cb461980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-87868e03-5f48-4d85-b083-b877cb461980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:35.984565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:35.986309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:35.988692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 300/624] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:35.995990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868e03-5f48-4d85-b083-b877cb461980 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:36.010206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d22bf4-3544-469f-86e1-0636e0b1615c None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=a5f678debf35484989502439a8780ba1, role_id=361ada32137e4db3aa12e6776e5789d7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:36.013263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d22bf4-3544-469f-86e1-0636e0b1615c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:36.043219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 325/625] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:35:35 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/a5f678debf35484989502439a8780ba1/roles/361ada32137e4db3aa12e6776e5789d7 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:35:36.051438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9019a-4141-4ff7-9fa3-f23e4a3de5d7 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:36.052347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9019a-4141-4ff7-9fa3-f23e4a3de5d7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:36.052944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9019a-4141-4ff7-9fa3-f23e4a3de5d7 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:36.056766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 326/626] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:36 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:36.064230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9019a-4141-4ff7-9fa3-f23e4a3de5d7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:36.125298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:36.191776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:36.215451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868e03-5f48-4d85-b083-b877cb461980 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:36.217035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9019a-4141-4ff7-9fa3-f23e4a3de5d7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:36.260817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36b4a8-0a15-48ef-8194-651aa5656438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:36.261494 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b4a8-0a15-48ef-8194-651aa5656438 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:36.261906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b4a8-0a15-48ef-8194-651aa5656438 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:36.262161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36b4a8-0a15-48ef-8194-651aa5656438 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:36.275984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36b4a8-0a15-48ef-8194-651aa5656438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-db36b4a8-0a15-48ef-8194-651aa5656438 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:36.281527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:36.283471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 327/627] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:36.285216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ddd2-0cff-4f21-b348-33222fdb6bb9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:36.286762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ddd2-0cff-4f21-b348-33222fdb6bb9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:36.286762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700ddd2-0cff-4f21-b348-33222fdb6bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:36.291681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504202ae-323a-4225-84bc-eb787485c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:36.292765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504202ae-323a-4225-84bc-eb787485c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:36.293273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504202ae-323a-4225-84bc-eb787485c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:36.294150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504202ae-323a-4225-84bc-eb787485c8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:36.296769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504202ae-323a-4225-84bc-eb787485c8a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:36.297349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504202ae-323a-4225-84bc-eb787485c8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:36.300665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504202ae-323a-4225-84bc-eb787485c8a5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:36.308294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6700ddd2-0cff-4f21-b348-33222fdb6bb9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:36.311642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6700ddd2-0cff-4f21-b348-33222fdb6bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:36.320998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 301/628] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:36.322688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3f0a-b90a-48ef-b313-0b8690203303 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:36.322981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3f0a-b90a-48ef-b313-0b8690203303 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:36.323264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd3f0a-b90a-48ef-b313-0b8690203303 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:36.325737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 302/629] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:36.327563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3f0a-b90a-48ef-b313-0b8690203303 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:36.437045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 328/630] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:36.451900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652934dd-afb9-4a07-8dfc-d62f0d20fc63 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:36.451900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652934dd-afb9-4a07-8dfc-d62f0d20fc63 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:36.451900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652934dd-afb9-4a07-8dfc-d62f0d20fc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:36.483826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-652934dd-afb9-4a07-8dfc-d62f0d20fc63 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:36.486381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-652934dd-afb9-4a07-8dfc-d62f0d20fc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:36.533959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd3f0a-b90a-48ef-b313-0b8690203303 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:36.587324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:36.608945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 329/631] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:36.609908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652934dd-afb9-4a07-8dfc-d62f0d20fc63 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:36.615121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:36.616491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:36.617007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:36.617497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:36.618898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:36.619449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:36.622141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:36.635600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:36.653643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 303/632] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:36.659782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:36.785926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652934dd-afb9-4a07-8dfc-d62f0d20fc63 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:36.866730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:36.867851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:36.869304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:36.870150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:36.887791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d390-8b36-40c8-be45-c4ae9c393fdb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:36.894747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:36.896562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:36.937985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:36.939538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:36.941284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:36.941284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:36.941284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:36.952722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 330/633] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:36.958320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:36.998514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.000138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.000882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.001630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.022489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:37.025696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:37.056542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:37.058340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:37.060068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:37.060068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:37.060068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:37.063373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 304/634] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:37.065428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:37.093232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:37.123252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:37.155300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd139b6-b2f1-4e2d-b680-802818fae6dc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:37.207945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.208736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.209016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.209315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.210349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:37.210801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:37.212211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:37.216633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81890957-c7c7-4a40-86e8-2683bb1a9ce2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:37.225802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 331/635] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:37.227837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:37.270364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f50ea-fc2d-4855-8853-4bdb40a3b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.271042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f50ea-fc2d-4855-8853-4bdb40a3b8fc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.271320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f50ea-fc2d-4855-8853-4bdb40a3b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.271591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f50ea-fc2d-4855-8853-4bdb40a3b8fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.284881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f50ea-fc2d-4855-8853-4bdb40a3b8fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ce9f50ea-fc2d-4855-8853-4bdb40a3b8fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:37.289927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:37.291038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 305/636] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:37.292565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f50ea-fc2d-4855-8853-4bdb40a3b8fc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:37.371246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ba5e9-fad6-42ba-bcf0-d9641585adec None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:37.397075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:37.406789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:37.416081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f50ea-fc2d-4855-8853-4bdb40a3b8fc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:37.439723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03a267-a422-40f4-ab0b-cd8bb96b3825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.441649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a267-a422-40f4-ab0b-cd8bb96b3825 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.442117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a267-a422-40f4-ab0b-cd8bb96b3825 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.443174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a267-a422-40f4-ab0b-cd8bb96b3825 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.462122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03a267-a422-40f4-ab0b-cd8bb96b3825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6b03a267-a422-40f4-ab0b-cd8bb96b3825 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:37.471927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:37.472963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:37.473817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:37.478586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 332/637] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:37.479600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03a267-a422-40f4-ab0b-cd8bb96b3825 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:37.481798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.482943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.483374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.483873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.485080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:37.485649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:37.488252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:37.512019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 306/638] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:37.512019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:37.628389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c4be0-5197-400a-8972-659a216e7d66 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:37.647386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03a267-a422-40f4-ab0b-cd8bb96b3825 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:37.667471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.668102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.668458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.668745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.669364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:37.669731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:37.671124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:37.680455 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 307/639] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:37.681302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:37.706616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:37.707827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.708554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.708862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.709147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] PATH_INFO: `/v3/users/nova` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.718336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:37.720100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:37.733358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:37.734524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 333/640] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:37.741006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:37.795490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:37.824769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d92f1-80b3-4779-9243-6a03c53180d9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:37.876870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.877756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.878106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.878448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.879069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:37.879399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:37.879607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6450f-200c-4ab9-b08a-4b8d15f47bca None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:37.881281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:37.892093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 308/641] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:37.893623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:37.940345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:37.941986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:37.942536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:37.943182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:37.958311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:37.961225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:37.979666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:37.981642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 334/642] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:37.991673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:38.041737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:38.079495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfe698-e146-4659-be1d-eb26f094a561 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:38.113363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:38.117446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ee57f-72eb-447a-821e-a7e56d132b15 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:38.141649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:38.142334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:38.142683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:38.142979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:38.160378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:38.162258 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:38.162689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:38.163539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:38.164138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:38.164606 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:38.165709 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:38.166244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:38.167991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:38.185954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:38.186939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:38.188000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:38.188000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:38.188000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:38.188347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 309/643] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:38.189709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:38.199281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 335/644] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:35:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:38.200742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:38.313530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b22a76-325d-4338-89e0-d94dd73c5586 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:38.357954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:38.367960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:38.369351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:38.370087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:38.370676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:38.382191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7be09-420f-461f-8931-bdebbf642147 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:38.389999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:38.391629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:38.409437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:38.410957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:38.412280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:38.412280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:38.412280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:38.412601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 310/645] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:38.413399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:38.456536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:38.457633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:38.458137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:38.458635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:38.460012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:38.460546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:38.463267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:38.497512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 336/646] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 4 12:35:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:38.498420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:38.516606 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:38.562061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab53d-3ddb-4c7d-b574-f49218646481 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:38.612978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:38.614432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:38.614940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:38.615440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:38.616741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:38.617445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:38.620101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:38.623893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e4363-c437-49d6-9d6a-29a4bbb1c614 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:38.641281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 311/647] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:38.641281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:38.678229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c52973-7deb-4b0d-adbe-04f78315f626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:38.679120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c52973-7deb-4b0d-adbe-04f78315f626 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:38.679463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c52973-7deb-4b0d-adbe-04f78315f626 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:38.680250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c52973-7deb-4b0d-adbe-04f78315f626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:38.705983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:38.775823 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6c8d6-fbaf-4dcd-85d5-0e8421bccc99 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:38.803530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c52973-7deb-4b0d-adbe-04f78315f626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:38.804995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c52973-7deb-4b0d-adbe-04f78315f626 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:38.819298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:38.820029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:38.820306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:38.820612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:38.821222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:38.821776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:38.822942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:38.823564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:38.835488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 312/648] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:38.836410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:38.937782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 337/649] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:38.938562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c52973-7deb-4b0d-adbe-04f78315f626 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:38.945557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b724b7e-8fa7-42a3-a033-b2265b2ae82d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:38.948057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:38.989285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce87b0e-45c0-47b4-bff8-f5c47750a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:38.989979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce87b0e-45c0-47b4-bff8-f5c47750a8ca None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:38.990208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce87b0e-45c0-47b4-bff8-f5c47750a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:38.990487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce87b0e-45c0-47b4-bff8-f5c47750a8ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.053098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c52973-7deb-4b0d-adbe-04f78315f626 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:39.068375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:39.079810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce87b0e-45c0-47b4-bff8-f5c47750a8ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:39.081759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce87b0e-45c0-47b4-bff8-f5c47750a8ca None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:39.093977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8414a11-b520-4c10-be70-402013b11ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:39.094756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414a11-b520-4c10-be70-402013b11ddc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.095038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414a11-b520-4c10-be70-402013b11ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.095310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414a11-b520-4c10-be70-402013b11ddc None admin] PATH_INFO: `/v3/users/glance` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.104191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8414a11-b520-4c10-be70-402013b11ddc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:39.105698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8414a11-b520-4c10-be70-402013b11ddc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b8414a11-b520-4c10-be70-402013b11ddc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:39.118262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:39.119410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:39.120339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 338/650] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:39.120903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d329-9a4d-4902-a5fe-05f2a2f07b58 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.121146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d329-9a4d-4902-a5fe-05f2a2f07b58 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.121419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495d329-9a4d-4902-a5fe-05f2a2f07b58 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.122818 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 339/651] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:39.123371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495d329-9a4d-4902-a5fe-05f2a2f07b58 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:39.201387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 313/652] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:39.202287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce87b0e-45c0-47b4-bff8-f5c47750a8ca None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:39.209693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:39.239368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495d329-9a4d-4902-a5fe-05f2a2f07b58 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:39.276344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:39.276988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.277271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.277832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.286737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:39.288202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:39.300550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:39.301786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 340/653] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:39.303153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:39.325766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce87b0e-45c0-47b4-bff8-f5c47750a8ca None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:39.342747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:39.367947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7a3e6-f3ca-48f9-bbd0-015b9ec7bae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:39.368734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7a3e6-f3ca-48f9-bbd0-015b9ec7bae5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.369013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7a3e6-f3ca-48f9-bbd0-015b9ec7bae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.369285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7a3e6-f3ca-48f9-bbd0-015b9ec7bae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.380260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7a3e6-f3ca-48f9-bbd0-015b9ec7bae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:39.381579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7a3e6-f3ca-48f9-bbd0-015b9ec7bae5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a3f7a3e6-f3ca-48f9-bbd0-015b9ec7bae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:39.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:39.398227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:39.399308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:39.399308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:39.399308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:39.399308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 314/654] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:39.399578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98465-6628-454c-8e9f-a353bf40c63e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.399667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98465-6628-454c-8e9f-a353bf40c63e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.400056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98465-6628-454c-8e9f-a353bf40c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.419956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d384014-0c3f-4752-ab7d-784083b55146 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:39.429709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-64c98465-6628-454c-8e9f-a353bf40c63e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:39.430931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-64c98465-6628-454c-8e9f-a353bf40c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:39.457994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:39.458521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.458795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.459066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.459791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:39.460097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:39.461549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:39.485008 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 341/655] 10.222.0.30 () {56 vars in 1137 bytes} [Tue Oct 4 12:35:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:39.485892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:39.493988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:39.512637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 315/656] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:39.513326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98465-6628-454c-8e9f-a353bf40c63e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:39.606133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:39.619809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9ce17-aabf-4cbf-8609-f14255d78641 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:39.647653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98465-6628-454c-8e9f-a353bf40c63e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:39.660673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:39.661722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.662251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.662567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.674879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:39.676347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:39.693645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:39.699373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:39.700385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:39.700385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:39.700385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:39.700385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 342/657] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:39.700385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:39.711679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:39.712223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.712505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.712805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.713498 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:39.713840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:39.715291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:39.738410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 316/658] 10.222.0.30 () {56 vars in 1139 bytes} [Tue Oct 4 12:35:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:39.738410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:39.804330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:39.854217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e4559-ec38-48ad-b522-adc6bb3bf8e8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:39.887698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565e48a-9bbd-4d35-9152-57fa69932d08 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:39.898944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf408451-5a27-4268-9028-552869938f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:39.899796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf408451-5a27-4268-9028-552869938f56 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.900112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf408451-5a27-4268-9028-552869938f56 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.900386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf408451-5a27-4268-9028-552869938f56 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:39.901355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf408451-5a27-4268-9028-552869938f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:39.901909 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf408451-5a27-4268-9028-552869938f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:39.904189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf408451-5a27-4268-9028-552869938f56 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:39.922015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 343/659] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:39.923123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf408451-5a27-4268-9028-552869938f56 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:39.927523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:39.934994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19482-b248-4078-ac35-8f2ad59b1b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:39.935958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19482-b248-4078-ac35-8f2ad59b1b07 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:39.936243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19482-b248-4078-ac35-8f2ad59b1b07 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:39.936522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19482-b248-4078-ac35-8f2ad59b1b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.021197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df19482-b248-4078-ac35-8f2ad59b1b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:40.022647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df19482-b248-4078-ac35-8f2ad59b1b07 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:40.059619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf408451-5a27-4268-9028-552869938f56 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:40.074743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:40.112433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:40.113480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:40.114023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:40.114517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.115685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:40.116228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:40.118882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:40.137120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 317/660] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:40.138088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19482-b248-4078-ac35-8f2ad59b1b07 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:40.140692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 344/661] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:40.143423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:40.240041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:40.255380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19482-b248-4078-ac35-8f2ad59b1b07 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:40.293832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abfed-09cc-4e73-80d4-5e7ac80736fa None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:40.294065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cf0c7-9bab-4e9b-8a88-a7b6188bdcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:40.294377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cf0c7-9bab-4e9b-8a88-a7b6188bdcbb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:40.294663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cf0c7-9bab-4e9b-8a88-a7b6188bdcbb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:40.294941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cf0c7-9bab-4e9b-8a88-a7b6188bdcbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.311051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:40.334540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d6b18-de40-4744-ac0a-614c1814bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:40.335351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d6b18-de40-4744-ac0a-614c1814bf8a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:40.335721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d6b18-de40-4744-ac0a-614c1814bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:40.336107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d6b18-de40-4744-ac0a-614c1814bf8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.353159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d6b18-de40-4744-ac0a-614c1814bf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d30d6b18-de40-4744-ac0a-614c1814bf8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:40.363338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:40.364388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:40.365220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 345/662] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:40.366501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d6b18-de40-4744-ac0a-614c1814bf8a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:40.389324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cf0c7-9bab-4e9b-8a88-a7b6188bdcbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:40.390899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cf0c7-9bab-4e9b-8a88-a7b6188bdcbb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:40.506627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 318/663] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:40.507658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cf0c7-9bab-4e9b-8a88-a7b6188bdcbb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:40.510546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d6b18-de40-4744-ac0a-614c1814bf8a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:40.541930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:40.555743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:40.556382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:40.556721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:40.557122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.564753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:40.566324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:40.571277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:40.580672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:40.582601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 346/664] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:40.584396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:40.655200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cf0c7-9bab-4e9b-8a88-a7b6188bdcbb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:40.709285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:40.710156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:40.710751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:40.711110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.716357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029832a0-1311-4d68-a7d0-8668f424720e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:40.725923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:40.728151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:40.744851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:40.746868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:40.748875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:40.748875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:40.748875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:40.748875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 319/665] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:40.748875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:40.758965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848379a-33be-4627-b543-4f42397e65af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:40.759745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848379a-33be-4627-b543-4f42397e65af None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:40.760080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848379a-33be-4627-b543-4f42397e65af None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:40.760420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848379a-33be-4627-b543-4f42397e65af None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.769690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848379a-33be-4627-b543-4f42397e65af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:40.771434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848379a-33be-4627-b543-4f42397e65af None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6848379a-33be-4627-b543-4f42397e65af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:40.786372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:40.787680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:40.789117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 347/666] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:40.790069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848379a-33be-4627-b543-4f42397e65af None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:40.841356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:40.870333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:40.881993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bade2-4b61-489a-8adb-1dcc97f8f943 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:40.917564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848379a-33be-4627-b543-4f42397e65af None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:40.936051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:40.936856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:40.937200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:40.937658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.938536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:40.938905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:40.940552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:40.951548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 320/667] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:40.953371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:40.961576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:40.962414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:40.962809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:40.963173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:40.979318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:40.982038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:41.006584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:41.008551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:41.010310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:41.010310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:41.010310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:41.010310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 348/668] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:41.010310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.098246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ed937-5b9d-4e21-8ed8-6d0508d83d79 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:41.127924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:41.135846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad222-b73e-48a1-99e8-2996acaa77dc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:41.141426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:41.142081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:41.142362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:41.142636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:41.143916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:41.144233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:41.145754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.159614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 321/669] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:41.160721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.178844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:41.179458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:41.179737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:41.180014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:41.180668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:41.180972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:41.182424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.188827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:41.196461 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 349/670] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:41.197225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.302404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1051b-bf51-4ca0-b1d4-4fe15e0bb1ce None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:41.324634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57b21-ae87-4472-b581-b1c2c5320dcd None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:41.341048 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:41.341718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:41.341999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:41.342273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:41.357327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:41.358866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.370412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:41.371487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:41.371982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:41.372484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:41.373802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:41.374367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:41.375569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:41.377271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:41.380537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:41.380537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:41.380537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:41.380537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 350/671] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:41.381112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.381266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.392801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:41.403134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 322/672] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:41.404446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.508696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:41.513454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ab3fb-1e6b-460e-8107-3d15c58b9202 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:41.544550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf35bec-90cf-4212-82d0-a18f1545fc3c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:41.550700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:41.551418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:41.551751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:41.552140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:41.552859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:41.553203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:41.554693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.569379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 351/673] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:41.570631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.597100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:41.597766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:41.598043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:41.598315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:41.599058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=175bb8ec9ccf487bb6e11f37bec82cb5) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:41.599377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:41.600861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.607843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 323/674] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/role_assignments?user.id=175bb8ec9ccf487bb6e11f37bec82cb5&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:41.609173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.686975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:41.745876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155089c-fcfd-4e79-8087-1ea60efe38d8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:41.793825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:41.794497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:41.794773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:41.795047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:41.801519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0e4b8-06b8-4e2a-918f-78b971b19420 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:41.803404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:41.804978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:41.818385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:41.820383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 352/675] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:41.822488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.864622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:41.865643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:41.866195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:41.866695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:41.867971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:41.868533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:41.872025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:41.896024 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 324/676] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:41.897589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:41.903179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:41.968294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77761a-1c56-4d66-998e-2e9d2e4ffede None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:42.000907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:42.012462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:42.013085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:42.013379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:42.013675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:42.014421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=d75de5eca91b46daaffd3bd79b69a6d6) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:42.014729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:42.016197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:42.029810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 353/677] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/role_assignments?user.id=d75de5eca91b46daaffd3bd79b69a6d6&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:42.030809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:42.111284 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6524ba-0964-4eeb-a5c0-b3ff4d0ed921 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:42.185299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:42.186375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:42.186885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:42.187371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:42.201998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:42.204656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:42.229254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:42.231467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 325/678] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:42.233664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:42.291916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1ed55-02ff-4d44-99fe-7acdd957ae84 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:42.341309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:42.341975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:42.342256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:42.342526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:42.343231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:42.343542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:42.345127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:42.360755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:42.361578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 354/679] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:42.362525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:42.421536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c00f9-58fd-4934-988f-aa4cec45543d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:42.456789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:42.457339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:42.457663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:42.458009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:42.459778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:42.466392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:42.467866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:42.480923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:42.482393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 326/680] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:42.484115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:42.531575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4c7be-51ea-4e91-83b8-42eb38937a4e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:42.571799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:42.572720 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:42.573149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:42.573566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:42.574440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:42.574892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:42.576743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:42.590554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 355/681] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:42.591787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:42.629825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da7aed-8cfd-4364-b5f8-753f799c78b9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:42.669178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:42.689933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:42.690950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:42.691388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:42.691815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:42.693766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=cdb8a57a383c475caff51c3d6d5c6a47) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:42.694564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:42.697267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:42.709199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 327/682] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:42 2022] GET /identity/v3/role_assignments?user.id=cdb8a57a383c475caff51c3d6d5c6a47&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:42.710699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:42.870839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaa468-4e77-4f91-892e-f6a56b944850 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:42.910291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:42.941414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:42.942076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:42.942357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:42.942965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:42.943824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:42.944235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:42.945871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:42.947453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68acf-f2dd-4a92-b8d2-7b64d54a4114 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:42.971574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 356/683] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 4 12:35:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:42.979464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:43.019495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:43.020525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:43.021017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:43.021483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:43.022903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=3e1d9844633a4afaacbb1867b8bbe582) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:43.023459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:43.026280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:43.039243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 328/684] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:42 2022] GET /identity/v3/role_assignments?user.id=3e1d9844633a4afaacbb1867b8bbe582&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:43.141231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35fcc-162b-4587-9b74-68458ff3fd73 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:43.215185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db4a0-a666-453c-a095-6d2ed03463bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:43.216481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db4a0-a666-453c-a095-6d2ed03463bf None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:43.217132 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db4a0-a666-453c-a095-6d2ed03463bf None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:43.217822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0db4a0-a666-453c-a095-6d2ed03463bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:43.277571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:43.320798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0db4a0-a666-453c-a095-6d2ed03463bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:43.322378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0db4a0-a666-453c-a095-6d2ed03463bf None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:43.461058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 357/685] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:43.469264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:43.567351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:43.698371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778a28-72f7-4042-a768-3b2cc395cdd0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:43.754132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:43.754799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:43.755085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:43.755365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:43.774273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:43.775850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:43.807908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:43.808920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:43.809818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:43.809818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:43.809818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:43.817847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 329/686] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:43.821305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db4a0-a666-453c-a095-6d2ed03463bf None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:43.981129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:44.077591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0db4a0-a666-453c-a095-6d2ed03463bf None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:44.162861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:44.163926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:44.164396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:44.164849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:44.166016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:44.166514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:44.169144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:44.193356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 358/687] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:44.202733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:44.482243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f462d4-8f3b-4804-910a-8658c8d3b468 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:44.485032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:44.574601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:44.575696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:44.576162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:44.576637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:44.599676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:44.602473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:44.636392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:44.637343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:44.638265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:44.638265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:44.638265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:44.638265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:44.638265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:44.638265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:44.638265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:44.638265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:44.639238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 330/688] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:44.649231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:44.857416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22aa3-65e1-4458-90b7-6ab7ea8aa46a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:44.917095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:44.927583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8f50c-ff86-4e0c-961c-ab7368f1404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:44.928610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f50c-ff86-4e0c-961c-ab7368f1404b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:44.929321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f50c-ff86-4e0c-961c-ab7368f1404b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:44.929826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f50c-ff86-4e0c-961c-ab7368f1404b None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:44.931036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8f50c-ff86-4e0c-961c-ab7368f1404b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:44.931568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8f50c-ff86-4e0c-961c-ab7368f1404b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:44.934316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8f50c-ff86-4e0c-961c-ab7368f1404b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:44.964483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 359/689] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:44.974322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:45.016116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295f7c2-3adc-42c6-a6cc-ccb76dc999d7 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:45.016372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295f7c2-3adc-42c6-a6cc-ccb76dc999d7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:45.016720 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295f7c2-3adc-42c6-a6cc-ccb76dc999d7 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:45.019226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 360/690] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:45.030908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2664377-c58f-418b-a844-5056432375a0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:45.031166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2664377-c58f-418b-a844-5056432375a0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:45.031487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2664377-c58f-418b-a844-5056432375a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:45.064234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d2664377-c58f-418b-a844-5056432375a0 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:45.067353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d2664377-c58f-418b-a844-5056432375a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:45.140406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1e90b-1c2e-46cd-934f-56f2f1f250a4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:45.180071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21cfd4-2dda-4df8-b7ae-5986223f1d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:45.180749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21cfd4-2dda-4df8-b7ae-5986223f1d23 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:45.181073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21cfd4-2dda-4df8-b7ae-5986223f1d23 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:45.181381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21cfd4-2dda-4df8-b7ae-5986223f1d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:45.182241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21cfd4-2dda-4df8-b7ae-5986223f1d23 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=a5f678debf35484989502439a8780ba1) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:45.182534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21cfd4-2dda-4df8-b7ae-5986223f1d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:45.183996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21cfd4-2dda-4df8-b7ae-5986223f1d23 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:45.191812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 331/691] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:44 2022] GET /identity/v3/role_assignments?user.id=a5f678debf35484989502439a8780ba1&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:45.193177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e249c0-174f-4a88-ad90-dcbd3470322a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:45.193458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e249c0-174f-4a88-ad90-dcbd3470322a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:45.193762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e249c0-174f-4a88-ad90-dcbd3470322a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:45.195308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 332/692] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:45.204346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 361/693] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:45.204764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa819-85c5-4b86-9f27-57efc64bbc9b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:45.205222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa819-85c5-4b86-9f27-57efc64bbc9b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:45.209638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fa819-85c5-4b86-9f27-57efc64bbc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:45.234882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-bd2fa819-85c5-4b86-9f27-57efc64bbc9b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:45.237261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bd2fa819-85c5-4b86-9f27-57efc64bbc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:45.284812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:45.399763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 333/694] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:45.584160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2664377-c58f-418b-a844-5056432375a0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:45.780751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2664377-c58f-418b-a844-5056432375a0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:45.819298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:45.843701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7e09-cb8b-4d72-bb0a-d0e8a6482dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:45.844660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e09-cb8b-4d72-bb0a-d0e8a6482dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:45.845060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e09-cb8b-4d72-bb0a-d0e8a6482dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:45.845459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e09-cb8b-4d72-bb0a-d0e8a6482dc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:45.865648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7e09-cb8b-4d72-bb0a-d0e8a6482dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-370b7e09-cb8b-4d72-bb0a-d0e8a6482dc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:45.874401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:45.876163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:45.877940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 362/695] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:45.882916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fa819-85c5-4b86-9f27-57efc64bbc9b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:45.996304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7e09-cb8b-4d72-bb0a-d0e8a6482dc8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:46.109820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fa819-85c5-4b86-9f27-57efc64bbc9b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:46.224320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:46.225378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:46.226135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:46.226859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:46.228306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:46.229073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:46.232045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:46.239612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7e09-cb8b-4d72-bb0a-d0e8a6482dc8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:46.252745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 334/696] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:46.267476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:46.291168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:46.292068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:46.292490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:46.292930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:46.293694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:46.295226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:46.308912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:46.310178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:35:46.311030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:46.313704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 363/697] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Oct 4 12:35:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:46.327395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:46.337312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:46.389620 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:46.461724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3934e-227c-4955-bd07-824279a1ec15 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:46.501959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a06d-c20d-4eb6-befa-669a737b5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:46.503398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a06d-c20d-4eb6-befa-669a737b5930 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:46.504010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a06d-c20d-4eb6-befa-669a737b5930 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:46.504428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a06d-c20d-4eb6-befa-669a737b5930 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:46.505209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a06d-c20d-4eb6-befa-669a737b5930 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:46.506009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a06d-c20d-4eb6-befa-669a737b5930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:46.507552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a06d-c20d-4eb6-befa-669a737b5930 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:46.513451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 364/698] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 4 12:35:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:46.514938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f397a-5b10-44d8-a7bc-f8fbfab271df None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:46.515370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f397a-5b10-44d8-a7bc-f8fbfab271df None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:46.515785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f397a-5b10-44d8-a7bc-f8fbfab271df None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:46.517444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 365/699] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:46.524390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f397a-5b10-44d8-a7bc-f8fbfab271df None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:46.541414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2921e-b629-49cd-9f76-052f3f392060 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:46.604729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69eecd-e3fe-4ca9-8fbe-86f1df350e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:46.605956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69eecd-e3fe-4ca9-8fbe-86f1df350e0f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:46.606436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69eecd-e3fe-4ca9-8fbe-86f1df350e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:46.606992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69eecd-e3fe-4ca9-8fbe-86f1df350e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:46.630662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69eecd-e3fe-4ca9-8fbe-86f1df350e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:46.633469 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69eecd-e3fe-4ca9-8fbe-86f1df350e0f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ed69eecd-e3fe-4ca9-8fbe-86f1df350e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:46.656677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:46.657933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:46.659442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:46.659442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:46.659442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:46.665975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f397a-5b10-44d8-a7bc-f8fbfab271df None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:46.666648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 335/700] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:46.668147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb3cc-22ef-400d-b287-4cea3f990e1c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:46.668555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb3cc-22ef-400d-b287-4cea3f990e1c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:46.668895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb3cc-22ef-400d-b287-4cea3f990e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:46.686295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:46.691011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-36bdb3cc-22ef-400d-b287-4cea3f990e1c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:46.692925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-36bdb3cc-22ef-400d-b287-4cea3f990e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:46.730405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:46.731914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:46.732878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:46.733680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:46.734811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:46.735342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:46.738884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:46.758336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 366/701] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 4 12:35:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:46.762454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:46.844178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:46.862568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 336/702] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:47.032354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b4d9-fb6e-405b-9484-5829ffc5ba30 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:47.057967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e9de-bde4-4f11-be2e-b6e081cf15cc None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:47.058536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e9de-bde4-4f11-be2e-b6e081cf15cc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:47.058921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e9de-bde4-4f11-be2e-b6e081cf15cc None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:47.061625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 337/703] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:47.070734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb30f-6c98-4e4f-bbdf-352c5ab17627 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:47.071071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb30f-6c98-4e4f-bbdf-352c5ab17627 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:47.071290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb30f-6c98-4e4f-bbdf-352c5ab17627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:47.095941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d1ccb30f-6c98-4e4f-bbdf-352c5ab17627 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:47.097876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:47.098289 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d1ccb30f-6c98-4e4f-bbdf-352c5ab17627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:47.098529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:47.098811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:47.099085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:47.099781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:47.100087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:47.101573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:47.117152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 367/704] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:47.127105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:47.169216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:47.239007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 338/705] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:47.266577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120632f-79f6-4387-9586-913bbccd9bd5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:47.278662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccb30f-6c98-4e4f-bbdf-352c5ab17627 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:47.314314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07772790-8020-4648-8650-c9e341e61722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:47.315837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07772790-8020-4648-8650-c9e341e61722 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:47.316341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07772790-8020-4648-8650-c9e341e61722 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:47.316813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07772790-8020-4648-8650-c9e341e61722 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:47.325713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07772790-8020-4648-8650-c9e341e61722 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:47.327645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07772790-8020-4648-8650-c9e341e61722 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-07772790-8020-4648-8650-c9e341e61722 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:47.342542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:47.343690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:47.344672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:47.347630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 368/706] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:35:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:47.353643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07772790-8020-4648-8650-c9e341e61722 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:47.522163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:47.539129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07772790-8020-4648-8650-c9e341e61722 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:47.564205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccb30f-6c98-4e4f-bbdf-352c5ab17627 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:47.602690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:47.608598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:47.609766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:47.610727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:47.610980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:47.612135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:47.612700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:47.612949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:47.613360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:47.615370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:47.616286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:47.619329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:47.626072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:47.628308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:47.647033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:47.648918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:47.650728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:47.650728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:47.650728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:47.654642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 339/707] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:47.655936 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:47.665764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 369/708] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:35:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:47.668058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:47.809164 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee9b7f-de63-4483-9a57-e05cc27bb1db None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:47.872652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:47.873528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:47.873835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:47.874095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] PATH_INFO: `/v3/services/network` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:47.874883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:47.875247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ced98-764f-4992-a6b2-7709ab9ffcc9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:47.876440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:47.888629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:47.890650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:47.892590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 340/709] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:47 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:47.894095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:47.951184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:47.952199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:47.952808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:47.953171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:47.954441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:47.954985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:47.957793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:47.962916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:47.984945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 370/710] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:47.984945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:48.001778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:48.046998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a3c06-c9a9-4dd8-8ff9-1361ea878bab None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:48.132266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b950-4006-40d5-83eb-14cdac2f7020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:48.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b950-4006-40d5-83eb-14cdac2f7020 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:48.133826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b950-4006-40d5-83eb-14cdac2f7020 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:48.134307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b950-4006-40d5-83eb-14cdac2f7020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:48.177396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134737c-3d9b-44dc-a098-af0148476643 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:48.258372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:48.259813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:48.260884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:48.262153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:48.263562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] RBAC: Adding query filter params (name=network) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:48.264124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:48.266832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:48.279573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 371/711] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:35:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:48.281503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:48.292057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4b950-4006-40d5-83eb-14cdac2f7020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:48.295177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4b950-4006-40d5-83eb-14cdac2f7020 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:48.397266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:48.450332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:48.491665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 341/712] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:48.492541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b950-4006-40d5-83eb-14cdac2f7020 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:48.520080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85cfa-4f2e-4021-855d-e5fae9f04656 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:48.565774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6d6fa-0484-4bcb-9e45-dd1ca0955305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:48.566453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d6fa-0484-4bcb-9e45-dd1ca0955305 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:48.566657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d6fa-0484-4bcb-9e45-dd1ca0955305 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:48.566994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6d6fa-0484-4bcb-9e45-dd1ca0955305 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:48.567716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6d6fa-0484-4bcb-9e45-dd1ca0955305 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:48.569232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6d6fa-0484-4bcb-9e45-dd1ca0955305 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:48.598133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 372/713] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:35:48 2022] POST /identity/v3/users => generated 254 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:35:48.598997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6d6fa-0484-4bcb-9e45-dd1ca0955305 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:48.689337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b950-4006-40d5-83eb-14cdac2f7020 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:48.716926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6d6fa-0484-4bcb-9e45-dd1ca0955305 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:48.758395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:48.775386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:48.776061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:48.776341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:48.778199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:48.779409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:48.784166 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:48.788648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:48.789067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:48.789888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] RBAC: Adding query filter params (type=network) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:48.790143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:48.791514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:48.801031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:48.802844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:48.805458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 342/714] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:35:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:48.829237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:48.831822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:48.835590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:48.835590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:48.835590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:48.835590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 373/715] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:48.843845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:48.866994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:49.021969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c530b-8250-4054-b91b-90de54a816d4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:49.070568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4820d-c255-4f59-b63c-596cdc4510e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:49.071207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4820d-c255-4f59-b63c-596cdc4510e9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.071592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4820d-c255-4f59-b63c-596cdc4510e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.071841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4820d-c255-4f59-b63c-596cdc4510e9 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.072422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4820d-c255-4f59-b63c-596cdc4510e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:49.072731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4820d-c255-4f59-b63c-596cdc4510e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:49.074204 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4820d-c255-4f59-b63c-596cdc4510e9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:49.097115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 343/716] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:49.105240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:49.194212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8750-2565-4dcf-a2d0-440f62ef2c21 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.195040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8750-2565-4dcf-a2d0-440f62ef2c21 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.195040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a8750-2565-4dcf-a2d0-440f62ef2c21 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.196416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 344/717] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:35:49.204614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348fcc-7537-44f4-8dcb-87e0cf89b116 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.204868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348fcc-7537-44f4-8dcb-87e0cf89b116 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.205180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d348fcc-7537-44f4-8dcb-87e0cf89b116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.247249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2d348fcc-7537-44f4-8dcb-87e0cf89b116 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:49.249551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2d348fcc-7537-44f4-8dcb-87e0cf89b116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:49.271534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d4f70-4d6c-4ccf-8534-fd040ca8a8bb None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:49.311468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:49.312017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.312294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.312563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.321213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:49.322726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:49.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:49.340491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:49.342564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 374/718] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:49.345699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:49.414304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:49.433654 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 345/719] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:49.434228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:49.543271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872f434-cb4b-4191-b378-ff43d46d46b9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:49.596948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:49.597470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.597774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.598040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.598813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:49.599117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:49.600630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:49.618428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 375/720] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:49.625122 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d348fcc-7537-44f4-8dcb-87e0cf89b116 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:49.715677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:49.876262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d348fcc-7537-44f4-8dcb-87e0cf89b116 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:49.921543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697763c4-39d4-42bf-8e57-89f051f800ba None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:49.936423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:49.947037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f21858-d3d6-4eb0-82b1-07cc23e632cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:49.947670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21858-d3d6-4eb0-82b1-07cc23e632cd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.947957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21858-d3d6-4eb0-82b1-07cc23e632cd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.948234 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f21858-d3d6-4eb0-82b1-07cc23e632cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.949098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f21858-d3d6-4eb0-82b1-07cc23e632cd None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=175bb8ec9ccf487bb6e11f37bec82cb5) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:49.949507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f21858-d3d6-4eb0-82b1-07cc23e632cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:49.951039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f21858-d3d6-4eb0-82b1-07cc23e632cd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:49.958519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 346/721] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:49 2022] GET /identity/v3/role_assignments?user.id=175bb8ec9ccf487bb6e11f37bec82cb5&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=b8bf66974c0448089a192ead432a35f2 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:49.959831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4603-5097-4f2a-bd52-01c671d8f1b1 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.960122 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4603-5097-4f2a-bd52-01c671d8f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.960503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4603-5097-4f2a-bd52-01c671d8f1b1 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.966372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 347/722] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:49.967927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2250b-49b5-4467-9edd-ff72c365a107 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.968220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2250b-49b5-4467-9edd-ff72c365a107 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.968526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2250b-49b5-4467-9edd-ff72c365a107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.984621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e54895-88dd-4c33-bcd4-279b87d16907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:49.985274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e54895-88dd-4c33-bcd4-279b87d16907 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:49.986049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e54895-88dd-4c33-bcd4-279b87d16907 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:49.986049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e54895-88dd-4c33-bcd4-279b87d16907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:49.993362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0ff2250b-49b5-4467-9edd-ff72c365a107 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:49.997589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0ff2250b-49b5-4467-9edd-ff72c365a107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:50.004292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e54895-88dd-4c33-bcd4-279b87d16907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-02e54895-88dd-4c33-bcd4-279b87d16907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:50.015541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:50.017209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:50.019093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:50.025591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 376/723] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:50.030989 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e54895-88dd-4c33-bcd4-279b87d16907 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:50.118421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:50.137203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 348/724] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 12:35:50.276252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e54895-88dd-4c33-bcd4-279b87d16907 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:50.350202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:50.351228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:50.351724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:50.352315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:50.353514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:50.354057 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:50.356599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:50.374938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 377/725] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:35:50.385308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2250b-49b5-4467-9edd-ff72c365a107 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:50.481281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:50.534181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:50.636360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2250b-49b5-4467-9edd-ff72c365a107 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:50.656202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b73ce-e114-4166-b65a-6382ed726f9d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:50.744921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:50.745932 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:50.746429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:50.746916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:50.767049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179f43f-2a2a-443d-8d5e-961ca6d7449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:50.768258 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179f43f-2a2a-443d-8d5e-961ca6d7449d None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:50.768592 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179f43f-2a2a-443d-8d5e-961ca6d7449d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:50.768866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179f43f-2a2a-443d-8d5e-961ca6d7449d None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:50.769811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179f43f-2a2a-443d-8d5e-961ca6d7449d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:50.771210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179f43f-2a2a-443d-8d5e-961ca6d7449d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:50.785545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:50.789783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:50.797589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 378/726] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:35:50 2022] POST /identity/v3/services => generated 251 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:50.815231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:50.816243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:50.817184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:50.817184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:50.817184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:50.817184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 349/727] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:50.823774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179f43f-2a2a-443d-8d5e-961ca6d7449d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:51.031839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:51.063695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179f43f-2a2a-443d-8d5e-961ca6d7449d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:51.102760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:51.103385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:51.103661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:51.103934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:51.104582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:51.104882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:51.106426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:51.119938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 379/728] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:51.130741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:51.215250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:51.304668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dae55c-462f-4c98-ab24-8757732a70f1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:51.353832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:51.354481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:51.354763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:51.355039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:51.365872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:51.367358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:51.386034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:51.387467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:51.388851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 350/729] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:51.393721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:51.521855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fea62-444f-4b81-8d5e-13266ed870cd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:51.561659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8715b-3fe4-4a50-a58f-314029ca7c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:51.562216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8715b-3fe4-4a50-a58f-314029ca7c9e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:51.562498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8715b-3fe4-4a50-a58f-314029ca7c9e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:51.562774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8715b-3fe4-4a50-a58f-314029ca7c9e None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:51.563624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8715b-3fe4-4a50-a58f-314029ca7c9e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:51.563944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8715b-3fe4-4a50-a58f-314029ca7c9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:51.566053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8715b-3fe4-4a50-a58f-314029ca7c9e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:51.583933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:51.595012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 380/730] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 4 12:35:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:51.603165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:51.759787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d73e-a94c-4720-893e-2002d1f372e6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:51.772868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:51.815420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b86d8-f75e-46ff-8f42-3d509bd4c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:51.815966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b86d8-f75e-46ff-8f42-3d509bd4c586 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:51.816253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b86d8-f75e-46ff-8f42-3d509bd4c586 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:51.816529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b86d8-f75e-46ff-8f42-3d509bd4c586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:51.927245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b86d8-f75e-46ff-8f42-3d509bd4c586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:51.928772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b86d8-f75e-46ff-8f42-3d509bd4c586 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:52.035609 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c55026-eb38-41a6-9f79-68935a075210 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:52.035961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c55026-eb38-41a6-9f79-68935a075210 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:52.036191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c55026-eb38-41a6-9f79-68935a075210 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:52.039126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 381/731] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:35:52.043769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a41a-e8be-41ea-b4f3-45f042e33a9f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:52.044061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a41a-e8be-41ea-b4f3-45f042e33a9f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:52.044322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a41a-e8be-41ea-b4f3-45f042e33a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:52.065842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ef61a41a-e8be-41ea-b4f3-45f042e33a9f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:52.067221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ef61a41a-e8be-41ea-b4f3-45f042e33a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:52.103309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 351/732] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 12:35:52.107863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b86d8-f75e-46ff-8f42-3d509bd4c586 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:52.118673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:52.210462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 382/733] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:52.270518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f8fc3-895b-43b7-88cc-885ac6dbbf6d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:52.270842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f8fc3-895b-43b7-88cc-885ac6dbbf6d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:52.271074 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f8fc3-895b-43b7-88cc-885ac6dbbf6d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:52.272752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 383/734] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:52.280504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f743-e3ee-4b11-b0bd-2d5a6d586bd3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:52.280805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f743-e3ee-4b11-b0bd-2d5a6d586bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:52.281061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f743-e3ee-4b11-b0bd-2d5a6d586bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:52.295903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b86d8-f75e-46ff-8f42-3d509bd4c586 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:52.331316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e1f0f743-e3ee-4b11-b0bd-2d5a6d586bd3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:52.332455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e1f0f743-e3ee-4b11-b0bd-2d5a6d586bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:52.335127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:52.335781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:52.336063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:52.336338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:52.348529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:52.350197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:52.366424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:52.367404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:52.368254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:52.368254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:52.368254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:52.368254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 352/735] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:52.375334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:52.499312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 384/736] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 12:35:52.530000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:52.603784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a480a4-8231-43ad-94aa-4be018751492 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:52.662254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:52.663556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:52.664177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:52.664790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:52.666177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:52.666852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:52.669371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:52.692782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 353/737] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:52.698796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0f743-e3ee-4b11-b0bd-2d5a6d586bd3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:52.745894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:52.839036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:52.943880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0f743-e3ee-4b11-b0bd-2d5a6d586bd3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:52.984169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:52.984841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:52.985119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:52.985392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:52.994471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:52.996054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:53.010851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:53.012960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 385/738] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:53.014985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:53.026464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1e161-b93f-45de-a6c7-501f6c2a958a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:53.050899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:53.072385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778056-5f13-409f-b935-73efe6f7007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:53.073255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778056-5f13-409f-b935-73efe6f7007a None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.073740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778056-5f13-409f-b935-73efe6f7007a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.074179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a778056-5f13-409f-b935-73efe6f7007a None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.075109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778056-5f13-409f-b935-73efe6f7007a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:53.076779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a778056-5f13-409f-b935-73efe6f7007a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:53.098079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 354/739] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:35:52 2022] POST /identity/v3/services => generated 240 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:35:53.099434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778056-5f13-409f-b935-73efe6f7007a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:53.200633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa819e30-619b-40de-98de-ffd0061e0c44 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:53.225366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:53.262317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a778056-5f13-409f-b935-73efe6f7007a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:53.264453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f836260-19b4-41e9-aa59-7ffa978ed966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:53.266286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f836260-19b4-41e9-aa59-7ffa978ed966 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.266668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f836260-19b4-41e9-aa59-7ffa978ed966 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.266848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f836260-19b4-41e9-aa59-7ffa978ed966 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.295858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f836260-19b4-41e9-aa59-7ffa978ed966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-9f836260-19b4-41e9-aa59-7ffa978ed966 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:53.313480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:53.315955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:35:53.317636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:53.325985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 386/740] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:53.329396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f0f-5902-4af9-8c58-49ee5972fdd0 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.329927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f0f-5902-4af9-8c58-49ee5972fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.330947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71209f0f-5902-4af9-8c58-49ee5972fdd0 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.334860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 387/741] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:53.336925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71209f0f-5902-4af9-8c58-49ee5972fdd0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:53.346358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca602d0-7f5a-4a97-bf3d-967fedc0de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:53.347953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca602d0-7f5a-4a97-bf3d-967fedc0de28 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.348730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca602d0-7f5a-4a97-bf3d-967fedc0de28 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.349529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca602d0-7f5a-4a97-bf3d-967fedc0de28 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.351201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca602d0-7f5a-4a97-bf3d-967fedc0de28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:53.352061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca602d0-7f5a-4a97-bf3d-967fedc0de28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:53.356509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca602d0-7f5a-4a97-bf3d-967fedc0de28 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:53.380549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 355/742] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:53.383588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085752-d0d6-427b-a079-d38074054f67 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.384486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085752-d0d6-427b-a079-d38074054f67 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.384989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c085752-d0d6-427b-a079-d38074054f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.426745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8c085752-d0d6-427b-a079-d38074054f67 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:53.428794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8c085752-d0d6-427b-a079-d38074054f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:53.494376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:53.556697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71209f0f-5902-4af9-8c58-49ee5972fdd0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:53.591571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 356/743] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:35:53.594247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085752-d0d6-427b-a079-d38074054f67 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:53.622284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda461-d658-488c-bf9d-6571d1073cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:53.623351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda461-d658-488c-bf9d-6571d1073cbc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.623926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda461-d658-488c-bf9d-6571d1073cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.624424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda461-d658-488c-bf9d-6571d1073cbc None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.631784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda461-d658-488c-bf9d-6571d1073cbc None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:53.631784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda461-d658-488c-bf9d-6571d1073cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:53.631784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda461-d658-488c-bf9d-6571d1073cbc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:53.648288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 388/744] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:35:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:53.651003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5290fd2-2d14-487b-a66e-0ff02d65dea7 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.651394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5290fd2-2d14-487b-a66e-0ff02d65dea7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.651885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5290fd2-2d14-487b-a66e-0ff02d65dea7 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.655553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 389/745] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:53.657890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5290fd2-2d14-487b-a66e-0ff02d65dea7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:53.754170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:53.808204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5290fd2-2d14-487b-a66e-0ff02d65dea7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:53.812328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c085752-d0d6-427b-a079-d38074054f67 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:53.849021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22bd4a-1429-430c-8c31-496649f73adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:53.849751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22bd4a-1429-430c-8c31-496649f73adf None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.850048 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22bd4a-1429-430c-8c31-496649f73adf None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.850300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22bd4a-1429-430c-8c31-496649f73adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.863994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22bd4a-1429-430c-8c31-496649f73adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:53.865468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22bd4a-1429-430c-8c31-496649f73adf None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:53.882650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:53.884108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.884849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-2d22bd4a-1429-430c-8c31-496649f73adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:53.885206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:53.886968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:53.888730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:53.888730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:53.888730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:53.889994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 390/746] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:53.890563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.891339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae058a9-4a20-426c-ad33-2ce6f162f402 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:53.891676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae058a9-4a20-426c-ad33-2ce6f162f402 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:53.891957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae058a9-4a20-426c-ad33-2ce6f162f402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:53.892941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=a5f678debf35484989502439a8780ba1) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:53.893886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:53.897121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:53.907683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 357/747] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:53 2022] GET /identity/v3/role_assignments?user.id=a5f678debf35484989502439a8780ba1&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=b8bf66974c0448089a192ead432a35f2 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:53.910171 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:53.915230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9ae058a9-4a20-426c-ad33-2ce6f162f402 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:53.916511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9ae058a9-4a20-426c-ad33-2ce6f162f402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:53.980428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:54.058120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 391/748] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:35:54.059703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae058a9-4a20-426c-ad33-2ce6f162f402 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:54.111109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:54.162335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1224394-6812-4a7e-85d7-6a5a4364538c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:54.230104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:54.231773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:54.232559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:54.233319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:54.235050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:54.235950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:54.239503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:54.254750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae058a9-4a20-426c-ad33-2ce6f162f402 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:54.264460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 358/749] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:54.270241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:54.325842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab581-2a62-4247-be94-2d3ea10c18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:54.326399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab581-2a62-4247-be94-2d3ea10c18f0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:54.326677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab581-2a62-4247-be94-2d3ea10c18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:54.326951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab581-2a62-4247-be94-2d3ea10c18f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:54.361388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab581-2a62-4247-be94-2d3ea10c18f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-402ab581-2a62-4247-be94-2d3ea10c18f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:54.366803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:54.368582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:54.370241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 392/750] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:54.373914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab581-2a62-4247-be94-2d3ea10c18f0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:54.505856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:54.525994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3b49f-f909-4eb4-aba1-3591b2301fcc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:54.555337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:54.588009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab581-2a62-4247-be94-2d3ea10c18f0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:54.605682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:54.606522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:54.606658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:54.606983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:54.619715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:54.621189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:54.642505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:54.644413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 359/751] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:35:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:54.646317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:54.659351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:54.660390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:54.660874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:54.661323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:54.662553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:54.663088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:54.665703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:54.683754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 393/752] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:54.685418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:54.830506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e2ddf-a32f-416e-8091-b2cfcf798066 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:54.874465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:54.875139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:54.875678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:54.875997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:54.877166 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:54.879056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:54.882684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7554d-4f0e-4b37-a92d-1567c7672437 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:54.889948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:54.891873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:54.895829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 360/753] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Oct 4 12:35:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:54.897434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:54.910413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:54.962448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:54.964036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:54.964740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:54.965341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:54.967284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:54.968111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:54.971802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:55.005481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 394/754] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 4 12:35:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:55.007299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:55.013791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:55.029423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bea01-0365-4cc9-95bd-f1bc72010bcc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:55.092179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:55.093766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:55.094517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:55.096552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:55.123932 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:55.128530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:55.158357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:55.160903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:55.162982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:55.162982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:55.162982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:55.164935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 361/755] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:55.165973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:55.172979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc113-d965-4648-ad1e-536a22d1d3a7 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:55.241114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:55.262136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:55.265149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:55.266384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:55.267203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:55.269202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:55.269978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:55.273718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:55.289658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 395/756] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 4 12:35:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:55.289658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:55.300441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f3bf7-b282-4143-bb0f-ac5b0d5e6136 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:55.366461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c5e17-3ab5-41eb-86eb-b70ef07f5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:55.366769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c5e17-3ab5-41eb-86eb-b70ef07f5e68 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:55.367064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c5e17-3ab5-41eb-86eb-b70ef07f5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:55.367340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c5e17-3ab5-41eb-86eb-b70ef07f5e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:55.428604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:55.465130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c5e17-3ab5-41eb-86eb-b70ef07f5e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:55.466641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c5e17-3ab5-41eb-86eb-b70ef07f5e68 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:55.538734 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f70a91-f26c-4974-bdec-a5b9bab18f5e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:55.556504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:55.586816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:55.587113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:55.587404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:55.587811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:55.588575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:55.589488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:55.590430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:55.610715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 396/757] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:55.611930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:55.654235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 362/758] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:35:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:35:55.655329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c5e17-3ab5-41eb-86eb-b70ef07f5e68 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:55.789419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c5e17-3ab5-41eb-86eb-b70ef07f5e68 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:55.807960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d5a5-f7a2-4c8e-831b-688e1d5f5a2a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:55.837669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:55.838315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:55.839046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:55.839323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:55.848349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:55.850160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:55.854797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:55.866893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659c82-a073-40e6-9ada-e695be856527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:55.867619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659c82-a073-40e6-9ada-e695be856527 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:55.867908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659c82-a073-40e6-9ada-e695be856527 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:55.868169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659c82-a073-40e6-9ada-e695be856527 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:55.869002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659c82-a073-40e6-9ada-e695be856527 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:55.869220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659c82-a073-40e6-9ada-e695be856527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:55.870772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:55.871699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:35:55.872609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:55.873136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659c82-a073-40e6-9ada-e695be856527 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:55.873205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 363/759] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:35:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:55.874421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:55.886842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 397/760] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 4 12:35:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:55.886842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cfa5e-f946-48cc-ad2f-09dca5f19d8b None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:55.886842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cfa5e-f946-48cc-ad2f-09dca5f19d8b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:55.886842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cfa5e-f946-48cc-ad2f-09dca5f19d8b None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:55.890133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 398/761] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:55.891049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cfa5e-f946-48cc-ad2f-09dca5f19d8b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:55.921653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:56.026030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600eb23-f7a6-4f1e-afb9-c312387b36e9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:56.062051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cfa5e-f946-48cc-ad2f-09dca5f19d8b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:56.064073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:56.065696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.066046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.066331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.080534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:56.082229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:56.097992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:56.098969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:56.099843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:56.099843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:56.099843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:56.099843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 364/762] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:56.100070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:56.120536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da516f-3191-4c18-985b-c8f924913d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:56.121814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da516f-3191-4c18-985b-c8f924913d34 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.122240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da516f-3191-4c18-985b-c8f924913d34 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.122651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da516f-3191-4c18-985b-c8f924913d34 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.123983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da516f-3191-4c18-985b-c8f924913d34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:56.124293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da516f-3191-4c18-985b-c8f924913d34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:56.126118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da516f-3191-4c18-985b-c8f924913d34 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:56.149997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 399/763] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:35:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:56.151315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670eaec-4d87-48d5-ba70-a857e5b8b1c2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.151622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670eaec-4d87-48d5-ba70-a857e5b8b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.151900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670eaec-4d87-48d5-ba70-a857e5b8b1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.172535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5670eaec-4d87-48d5-ba70-a857e5b8b1c2 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:56.173798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5670eaec-4d87-48d5-ba70-a857e5b8b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:56.213039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:56.235594 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:56.240807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cce27-b1aa-45a3-8edd-7a3ae7d5d2b7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:56.278317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:56.278945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.279231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.279508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.280220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] RBAC: Adding query filter params (interface=public, service_id=45385ac17fc947559bb1c402046f77ba, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:56.280534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:56.281950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:56.285144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 400/764] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:35:56.286552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670eaec-4d87-48d5-ba70-a857e5b8b1c2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:56.291299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 365/765] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 4 12:35:56 2022] GET /identity/v3/endpoints?service_id=45385ac17fc947559bb1c402046f77ba&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:56.292172 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:56.450564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670eaec-4d87-48d5-ba70-a857e5b8b1c2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:56.481857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16e511-8c53-41ea-ac6e-c42f1b130b28 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:56.495826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:56.496778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.497065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.497652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.498326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:56.498634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:56.500036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:56.514862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 401/766] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:56.515753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:56.534610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:56.535552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.535835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.536680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.550569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:56.553973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:56.557462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:56.565252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:56.577128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:56.578193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:56.579079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:56.579079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:56.579079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:56.579079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 366/767] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:56.579482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:56.643441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e341-1fbc-49c0-bb3f-fc3d7d425777 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:56.686053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f7069-e1d1-4a8e-b699-67febde1255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:56.686678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f7069-e1d1-4a8e-b699-67febde1255f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.686966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f7069-e1d1-4a8e-b699-67febde1255f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.687241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f7069-e1d1-4a8e-b699-67febde1255f None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.687877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f7069-e1d1-4a8e-b699-67febde1255f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:56.689296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f7069-e1d1-4a8e-b699-67febde1255f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:56.695642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 402/768] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:35:56 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:56.701820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f7069-e1d1-4a8e-b699-67febde1255f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:56.837256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd5b5d-fa83-4671-9d80-2e8097716928 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:56.851072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f7069-e1d1-4a8e-b699-67febde1255f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:56.853797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:56.894253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:56.894924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.895207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.895483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.902037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:56.902964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:56.903465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:56.903920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] PATH_INFO: `/v3/services/network` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:56.904424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:56.904538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:56.906044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:56.906213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:56.917018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:56.918116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:35:56.918970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 403/769] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:56 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:56.919759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:56.923400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:56.924426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:56.925300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:56.925300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:56.925300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:56.925300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:56.925300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:56.925300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:56.925300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:56.925300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:56.926958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 367/770] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:56.929377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:56.991550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:57.048581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a883-cf29-49d5-8073-6b2e6e87c3b2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:57.056588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf69b7-3264-4f2f-8a46-2d5252bb868e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:57.092221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:57.092852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.093136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.093478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.094163 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] RBAC: Adding query filter params (name=network) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:57.094470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:57.095935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:57.101337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:57.102012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.102200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 368/771] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:35:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:57.102319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.102542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.103055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:57.103245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:57.103504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:57.109682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:57.129281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 404/772] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:57.130334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:57.182201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:57.225371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205c7f6-c0ab-48ad-a2ce-9913f6b39e4b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:57.249708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:57.263239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4586d4-b616-4a5b-9146-6a4469ab2a73 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:57.283804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:57.284765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.285273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.286325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.287264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:57.288224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:57.290482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:57.310939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 369/773] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:57.312974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:57.318084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67578124-cfad-497f-9aef-23f077edffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:57.319868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578124-cfad-497f-9aef-23f077edffec None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.320169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578124-cfad-497f-9aef-23f077edffec None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.320449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67578124-cfad-497f-9aef-23f077edffec None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.321106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67578124-cfad-497f-9aef-23f077edffec None admin] RBAC: Adding query filter params (type=network) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:57.321419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67578124-cfad-497f-9aef-23f077edffec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:57.322865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67578124-cfad-497f-9aef-23f077edffec None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:57.330054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 405/774] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:35:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:57.331422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67578124-cfad-497f-9aef-23f077edffec None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:57.464540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:57.473538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3392e-fb77-4f81-a5ed-2b5b69cf3fde None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:57.496477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67578124-cfad-497f-9aef-23f077edffec None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:57.516220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:57.516763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.517044 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.517386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.525264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:57.526832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:35:57.540808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:57.542418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 370/775] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:57.544190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:57.555915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f04c4-7772-4a6b-9971-5e73cd0881ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:57.556923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f04c4-7772-4a6b-9971-5e73cd0881ed None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.557413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f04c4-7772-4a6b-9971-5e73cd0881ed None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.558109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f04c4-7772-4a6b-9971-5e73cd0881ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.559147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f04c4-7772-4a6b-9971-5e73cd0881ed None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=da6017ad9ed5432f91dcb909b72f9a84) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:57.559596 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f04c4-7772-4a6b-9971-5e73cd0881ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:57.561794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f04c4-7772-4a6b-9971-5e73cd0881ed None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:57.578156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 406/776] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:35:57 2022] GET /identity/v3/role_assignments?user.id=da6017ad9ed5432f91dcb909b72f9a84&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:57.582324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc238-099b-4816-9e3b-ea8c6c782f14 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.583520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc238-099b-4816-9e3b-ea8c6c782f14 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.584941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc238-099b-4816-9e3b-ea8c6c782f14 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.588875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 407/777] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:57.590647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc238-099b-4816-9e3b-ea8c6c782f14 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:57.591532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:57.710962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc8445-33cb-4c9e-82dc-3dd6f6d2c8b1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:57.756907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610486a4-de33-4f3f-a788-b708c5cf1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:57.757546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610486a4-de33-4f3f-a788-b708c5cf1a59 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.757883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610486a4-de33-4f3f-a788-b708c5cf1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.758156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610486a4-de33-4f3f-a788-b708c5cf1a59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.758887 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610486a4-de33-4f3f-a788-b708c5cf1a59 None admin] RBAC: Adding query filter params (interface=public, service_id=109d8efc35a04cb0a609eef64cb73a2d, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:57.759199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610486a4-de33-4f3f-a788-b708c5cf1a59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:57.760703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610486a4-de33-4f3f-a788-b708c5cf1a59 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:57.768250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 371/778] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 4 12:35:57 2022] GET /identity/v3/endpoints?service_id=109d8efc35a04cb0a609eef64cb73a2d&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:57.769543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30bd21-9c8c-4f55-984c-9f0a8a4efded None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.769950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30bd21-9c8c-4f55-984c-9f0a8a4efded None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.770233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30bd21-9c8c-4f55-984c-9f0a8a4efded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.793942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6b30bd21-9c8c-4f55-984c-9f0a8a4efded None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:57.795076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc238-099b-4816-9e3b-ea8c6c782f14 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:57.795713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6b30bd21-9c8c-4f55-984c-9f0a8a4efded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:57.873983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:57.875876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:57.876631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:57.877441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:57.879234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:57.880030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:57.883800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:57.905713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 372/779] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:35:57.911044 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30bd21-9c8c-4f55-984c-9f0a8a4efded None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:57.921753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 408/780] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:57.944392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:58.005317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:58.005963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:58.133915 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30bd21-9c8c-4f55-984c-9f0a8a4efded None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:58.195833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bdea7-eddb-49a9-a476-aea1ba9380f4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:58.200858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ec079-7272-4d6d-b99e-c482d6b2dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:58.201482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ec079-7272-4d6d-b99e-c482d6b2dc3c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:58.201784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ec079-7272-4d6d-b99e-c482d6b2dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:58.202053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ec079-7272-4d6d-b99e-c482d6b2dc3c None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:58.202668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ec079-7272-4d6d-b99e-c482d6b2dc3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:58.209832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ec079-7272-4d6d-b99e-c482d6b2dc3c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:58.216714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 373/781] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:35:57 2022] GET /identity/v3/services => generated 772 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:58.256453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0c14e-3914-445a-bf93-f5ea3c95faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:58.257158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c14e-3914-445a-bf93-f5ea3c95faac None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:58.257437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c14e-3914-445a-bf93-f5ea3c95faac None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:58.257783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0c14e-3914-445a-bf93-f5ea3c95faac None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/175bb8ec9ccf487bb6e11f37bec82cb5/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:58.259969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0c14e-3914-445a-bf93-f5ea3c95faac None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=175bb8ec9ccf487bb6e11f37bec82cb5, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:58.261484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0c14e-3914-445a-bf93-f5ea3c95faac None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:58.290175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 409/782] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:35:57 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/175bb8ec9ccf487bb6e11f37bec82cb5/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:35:58.398388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ec079-7272-4d6d-b99e-c482d6b2dc3c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:58.569041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:58.580873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ec079-7272-4d6d-b99e-c482d6b2dc3c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:58.633111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6239-76f3-4231-ae93-7e1eee1e26e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:58.633803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6239-76f3-4231-ae93-7e1eee1e26e9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:58.634087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6239-76f3-4231-ae93-7e1eee1e26e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:58.634362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6239-76f3-4231-ae93-7e1eee1e26e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:58.653332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f6239-76f3-4231-ae93-7e1eee1e26e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e11f6239-76f3-4231-ae93-7e1eee1e26e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:35:58.658705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:58.661077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:58.662388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 374/783] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:35:58.666773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0c14e-3914-445a-bf93-f5ea3c95faac None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:58.761464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:58.805380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0c14e-3914-445a-bf93-f5ea3c95faac None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:58.867700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:58.868756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:58.869072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:58.869528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:58.871029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:58.871364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:58.873146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:58.890526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 410/784] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:58.896343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6239-76f3-4231-ae93-7e1eee1e26e9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:59.086216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6239-76f3-4231-ae93-7e1eee1e26e9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:59.135368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0bb4-3db8-489a-964a-39769b3e0931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:59.136588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0bb4-3db8-489a-964a-39769b3e0931 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:59.137138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0bb4-3db8-489a-964a-39769b3e0931 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:59.137737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0bb4-3db8-489a-964a-39769b3e0931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:59.157083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f0bb4-3db8-489a-964a-39769b3e0931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:59.160485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f0bb4-3db8-489a-964a-39769b3e0931 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c95f0bb4-3db8-489a-964a-39769b3e0931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:35:59.195776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:59.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:35:59.199367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:35:59.199367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:35:59.199367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:59.203035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 375/785] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:59.209500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:59.547072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5af49-2665-479d-875d-6f8d9a2b9753 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:59.547390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5af49-2665-479d-875d-6f8d9a2b9753 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:59.547640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5af49-2665-479d-875d-6f8d9a2b9753 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:59.549416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 376/786] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:35:59.559104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43058bed-fefe-4faf-9a68-0d9791804ac2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:59.559371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43058bed-fefe-4faf-9a68-0d9791804ac2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:59.559748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43058bed-fefe-4faf-9a68-0d9791804ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:59.578037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:59.581846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-43058bed-fefe-4faf-9a68-0d9791804ac2 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:35:59.583833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-43058bed-fefe-4faf-9a68-0d9791804ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:35:59.584773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9b474-acf1-4570-bbaf-4d009b5d9f60 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:59.667527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 377/787] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:35:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:35:59.682459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:59.683113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:59.683455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:59.683735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:59.684400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:35:59.684704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:59.686130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:59.689372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:59.701244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 411/788] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:35:59.707383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43058bed-fefe-4faf-9a68-0d9791804ac2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:59.885125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43058bed-fefe-4faf-9a68-0d9791804ac2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:35:59.933687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:35:59.934710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:35:59.935253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:35:59.935753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:35:59.939148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:35:59.944367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:35:59.945943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:35:59.959078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:35:59.960051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:35:59.960986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 378/789] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:35:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:35:59.967014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:35:59.976764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:00.292397 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2f8c6-12b6-4237-aada-3e0c872641d3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:00.321683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de8d9a-2435-46a6-95f4-a3d6e5556ef4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:00.363290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:00.363921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:00.364198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:00.364472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:00.365826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:00.366138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:00.368297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:00.372057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:00.372711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:00.372987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:00.373256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:00.373874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:00.375272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:00.391457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:00.392563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 12:36:00.394636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:00.399776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 379/790] 10.222.0.30 () {56 vars in 1129 bytes} [Tue Oct 4 12:35:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:00.401623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:00.419684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 412/791] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 4 12:35:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:00.428510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:00.553135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:00.594055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:00.621724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab0625-2393-41fb-81e7-fce7445929f2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:00.680169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534d6dd-ae90-4f71-8b37-94a302a8acee None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:00.680566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d880475-e690-4b74-8c99-eb056da36493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:00.681546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d880475-e690-4b74-8c99-eb056da36493 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:00.682089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d880475-e690-4b74-8c99-eb056da36493 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:00.682557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d880475-e690-4b74-8c99-eb056da36493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:00.703425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d880475-e690-4b74-8c99-eb056da36493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:00.706289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d880475-e690-4b74-8c99-eb056da36493 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0d880475-e690-4b74-8c99-eb056da36493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:00.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:00.739495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:00.741351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:00.741351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:00.741351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:00.741351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 413/792] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:00.742607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9fc1-f88f-4868-a7b8-e78b6c67e4bd None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:00.742925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9fc1-f88f-4868-a7b8-e78b6c67e4bd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:00.743491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9fc1-f88f-4868-a7b8-e78b6c67e4bd None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:00.752731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 414/793] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:00.752731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9fc1-f88f-4868-a7b8-e78b6c67e4bd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:00.754712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef11665-d088-45a4-b314-2977cf56c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:00.756032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11665-d088-45a4-b314-2977cf56c699 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:00.756813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11665-d088-45a4-b314-2977cf56c699 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:00.757301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef11665-d088-45a4-b314-2977cf56c699 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:00.758724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11665-d088-45a4-b314-2977cf56c699 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:00.759601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11665-d088-45a4-b314-2977cf56c699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:00.762584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef11665-d088-45a4-b314-2977cf56c699 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:00.773426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 380/794] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 4 12:36:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:00.775973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2b20-19ca-4980-895c-5a7b92de3be3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:00.776781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2b20-19ca-4980-895c-5a7b92de3be3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:00.777865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2b20-19ca-4980-895c-5a7b92de3be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:00.808604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-57ba2b20-19ca-4980-895c-5a7b92de3be3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:00.811039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-57ba2b20-19ca-4980-895c-5a7b92de3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:00.926583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9fc1-f88f-4868-a7b8-e78b6c67e4bd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:00.938124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:00.957998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 381/795] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:00.960670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba2b20-19ca-4980-895c-5a7b92de3be3 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:00.977454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:00.978903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:00.979387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:00.980537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:00.981458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:00.982097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:00.984323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:01.007104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 415/796] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:01.012598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:01.096510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:01.154499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba2b20-19ca-4980-895c-5a7b92de3be3 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:01.194595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:01.195705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.196383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.197127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.198821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:01.199753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:01.202712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:01.217913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 382/797] 10.222.0.30 () {56 vars in 1124 bytes} [Tue Oct 4 12:36:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:01.219814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:01.288411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc0d1-6c57-4d3e-be9c-f9b8394af94e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:01.332929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:01.333784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.334071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.334375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.342640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:01.344913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:01.359127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:01.360183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:01.361100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 416/798] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:01.361647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:01.377992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618474b1-4462-43b2-9ea5-f4ee0f91c763 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:01.391096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:01.415815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:01.448223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79356379-84d4-4831-810a-d3ce41bd0457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:01.449270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356379-84d4-4831-810a-d3ce41bd0457 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.449820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356379-84d4-4831-810a-d3ce41bd0457 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.450318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356379-84d4-4831-810a-d3ce41bd0457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.451350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79356379-84d4-4831-810a-d3ce41bd0457 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:01.453828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79356379-84d4-4831-810a-d3ce41bd0457 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:01.493411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 383/799] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:36:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:36:01.502853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9874435-37e3-4025-bb03-e331c33c0e40 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.502853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9874435-37e3-4025-bb03-e331c33c0e40 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.502853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9874435-37e3-4025-bb03-e331c33c0e40 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.502853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 384/800] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:01.502853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9874435-37e3-4025-bb03-e331c33c0e40 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:01.511022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abcb3a-1b64-421e-92da-806d9c43fe60 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:01.562921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621c7a9-6f44-438d-ae44-cb1d572f9524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:01.563566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c7a9-6f44-438d-ae44-cb1d572f9524 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.563965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c7a9-6f44-438d-ae44-cb1d572f9524 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.564243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621c7a9-6f44-438d-ae44-cb1d572f9524 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.578900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621c7a9-6f44-438d-ae44-cb1d572f9524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-5621c7a9-6f44-438d-ae44-cb1d572f9524 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:01.585749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:01.588717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:36:01.590722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:01.593842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 417/801] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:36:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:01.593998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aea25-f0f4-42fa-9aaa-71d1b6131c37 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.594259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aea25-f0f4-42fa-9aaa-71d1b6131c37 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.594538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aea25-f0f4-42fa-9aaa-71d1b6131c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.613910 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-549aea25-f0f4-42fa-9aaa-71d1b6131c37 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:01.615065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-549aea25-f0f4-42fa-9aaa-71d1b6131c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:01.678255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9874435-37e3-4025-bb03-e331c33c0e40 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:01.715220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 418/802] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:01.716505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aea25-f0f4-42fa-9aaa-71d1b6131c37 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:01.741841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a1c9e-477b-4691-b375-3f67dc0bf83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:01.742885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a1c9e-477b-4691-b375-3f67dc0bf83a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.743384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a1c9e-477b-4691-b375-3f67dc0bf83a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.743894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a1c9e-477b-4691-b375-3f67dc0bf83a None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.745135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a1c9e-477b-4691-b375-3f67dc0bf83a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:01.745730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a1c9e-477b-4691-b375-3f67dc0bf83a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:01.749253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a1c9e-477b-4691-b375-3f67dc0bf83a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:01.749456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:01.771420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 385/803] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:01.774706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0178b6-1965-45d3-9351-0a48100d72a8 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.775539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0178b6-1965-45d3-9351-0a48100d72a8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.776765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0178b6-1965-45d3-9351-0a48100d72a8 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.779943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 386/804] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:01.782626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0178b6-1965-45d3-9351-0a48100d72a8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:01.839592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:01.886865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aea25-f0f4-42fa-9aaa-71d1b6131c37 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:01.918578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0178b6-1965-45d3-9351-0a48100d72a8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:01.931331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034844e6-52e3-4f93-8251-e08f1a525741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:01.932304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034844e6-52e3-4f93-8251-e08f1a525741 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.932787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034844e6-52e3-4f93-8251-e08f1a525741 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.933276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034844e6-52e3-4f93-8251-e08f1a525741 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.934474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034844e6-52e3-4f93-8251-e08f1a525741 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:01.935532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034844e6-52e3-4f93-8251-e08f1a525741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:01.937427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034844e6-52e3-4f93-8251-e08f1a525741 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:01.949123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 419/805] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:36:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:01.950880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee596c1-f258-4e63-b206-23f5f00a3fe8 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.951384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee596c1-f258-4e63-b206-23f5f00a3fe8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.951891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee596c1-f258-4e63-b206-23f5f00a3fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.974364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e242ba-e1c4-4b46-89b6-89393fd808f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:01.975281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e242ba-e1c4-4b46-89b6-89393fd808f0 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:01.975773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e242ba-e1c4-4b46-89b6-89393fd808f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:01.976263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e242ba-e1c4-4b46-89b6-89393fd808f0 None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/a5f678debf35484989502439a8780ba1/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:01.977840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bee596c1-f258-4e63-b206-23f5f00a3fe8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:01.979661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e242ba-e1c4-4b46-89b6-89393fd808f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=a5f678debf35484989502439a8780ba1, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:01.980020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bee596c1-f258-4e63-b206-23f5f00a3fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:01.982326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e242ba-e1c4-4b46-89b6-89393fd808f0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:02.007513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 387/806] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:36:01 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/a5f678debf35484989502439a8780ba1/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:36:02.008870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e242ba-e1c4-4b46-89b6-89393fd808f0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:02.105868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 420/807] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:02.107340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee596c1-f258-4e63-b206-23f5f00a3fe8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:02.116253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:02.211476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:02.223734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e242ba-e1c4-4b46-89b6-89393fd808f0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:02.281444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee596c1-f258-4e63-b206-23f5f00a3fe8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:02.287923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:02.288966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:02.289421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:02.289930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:02.317089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:02.319295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:02.329025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:02.329713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:02.330566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:02.333345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] PATH_INFO: `/v3/services/network` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:02.333345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:02.333345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:02.345364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:02.346599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:02.347817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 421/808] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:02 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:02.352982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:02.359354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:02.362562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:02.365458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:02.365458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:02.365458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:02.365458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 388/809] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:02.374674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:02.441502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:02.486719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62873ba-a4c6-4c1c-8fd5-6f2db42b8b46 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:02.530684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:02.531324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:02.531605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:02.531881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:02.532529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] RBAC: Adding query filter params (name=network) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:02.532836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:02.534373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:02.540332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 422/810] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:02.546329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:02.670872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5e985-d736-4c71-a211-e35cabd4f7b4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:02.693896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e62bd4-2f1b-4982-af3a-852ad9620058 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:02.731923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:02.733082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:02.733563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:02.734020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:02.735677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:02.737987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:02.739527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:02.741077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:02.742255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:02.742614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:02.742962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:02.743756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:02.744073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:02.744239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:02.745723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:02.759202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 423/811] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:02.760457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:02.773803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 389/812] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:02.775522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:02.792084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:02.909477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8798fd-777c-4887-8a13-f832ed6f1dd5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:02.955712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a5a5-d7b4-4d74-8dc1-e9d8724c0ff7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:02.958403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246901a-2e79-4ed0-afec-728c891e005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:02.959187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246901a-2e79-4ed0-afec-728c891e005e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:02.959532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246901a-2e79-4ed0-afec-728c891e005e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:02.960115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246901a-2e79-4ed0-afec-728c891e005e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:02.975984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246901a-2e79-4ed0-afec-728c891e005e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-8246901a-2e79-4ed0-afec-728c891e005e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:02.982904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:02.985381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:02.987636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:02.990099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 424/813] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:02.991030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246901a-2e79-4ed0-afec-728c891e005e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:03.030093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d435044-0d8a-4988-9ee8-86b403ac71b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:03.030093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435044-0d8a-4988-9ee8-86b403ac71b6 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:03.030093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435044-0d8a-4988-9ee8-86b403ac71b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:03.030093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435044-0d8a-4988-9ee8-86b403ac71b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:03.030715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d435044-0d8a-4988-9ee8-86b403ac71b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:03.031026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d435044-0d8a-4988-9ee8-86b403ac71b6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:03.055189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 390/814] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:36:02 2022] POST /identity/v3/endpoints => generated 337 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:03.056275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d435044-0d8a-4988-9ee8-86b403ac71b6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:03.072005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:03.170107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:03.212966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246901a-2e79-4ed0-afec-728c891e005e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:03.234528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d435044-0d8a-4988-9ee8-86b403ac71b6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:03.308585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:03.309115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:03.309394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:03.309688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:03.310433 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:03.310777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:03.312135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:03.323223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:03.323503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 391/815] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:03.324788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:03.325276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:03.326432 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:03.338751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:03.349493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:03.352139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:03.380716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:03.381754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:03.382703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:03.383225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 425/816] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:36:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:03.389580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:03.485708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde57f23-080c-416c-8052-1d152c5a5c48 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:03.537835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:03.544802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:03.545456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:03.545779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:03.546093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:03.560190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:03.561329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:03.577133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:03.579094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:03.581202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:03.581202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:03.581202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:03.581202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 392/817] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:03.584762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:03.638389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849606-6d62-4a7b-b295-70e8223bf3d9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:03.672128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:03.695658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630b308-b0eb-4a4e-aba1-a2d755873e8d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:03.709580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:03.710975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:03.711655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:03.712342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:03.713840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:03.714717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:03.717861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:03.732957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:03.733634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:03.733928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:03.734206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:03.734861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:03.735167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:03.739276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:03.755259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 393/818] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:03.756286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:03.769788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 426/819] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 4 12:36:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:03.772822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:03.795468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:03.872346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b9206-0c79-4080-a37c-9054ee7a8995 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:03.912325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:03.912972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:03.913251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:03.913527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:03.921741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:03.923359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:03.936300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:03.938221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:36:03.940739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:03.942959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 394/820] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:36:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:03.943933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:03.997228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea8968-2fb3-49ed-ab7b-3fd7e08547b6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:04.050140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:04.060959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c21577-5eab-4ad4-ba4c-dc8b6fc8838b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:04.073293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:04.074855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.075785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.076681 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.099783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:04.100073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:04.100426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.100695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.101144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.102084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:04.102392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:04.103924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:04.104987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:04.133264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 395/821] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:36:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:04.134304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:04.137387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:04.139196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:04.140901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:04.140901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:04.140901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:04.152869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 427/822] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:04.155018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:04.214267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:04.275725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57410ddf-65aa-4590-8abb-872ab4beaccf None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:04.328974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24af66-00d9-4555-b0b7-3d24b82748d8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:04.329222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a032d93-4e92-44ca-9c08-bfd5ea4750bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:04.329645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a032d93-4e92-44ca-9c08-bfd5ea4750bb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.330463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a032d93-4e92-44ca-9c08-bfd5ea4750bb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.330738 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a032d93-4e92-44ca-9c08-bfd5ea4750bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.360564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:04.372303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbf136-fac9-4b91-8547-d04488d76af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:04.372871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf136-fac9-4b91-8547-d04488d76af8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.373142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf136-fac9-4b91-8547-d04488d76af8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.373423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbf136-fac9-4b91-8547-d04488d76af8 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.374110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbf136-fac9-4b91-8547-d04488d76af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:04.374417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbf136-fac9-4b91-8547-d04488d76af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:04.375845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbf136-fac9-4b91-8547-d04488d76af8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:04.392185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 428/823] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:04.395054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b233-7b04-40c1-b98c-74397c784f91 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.395531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b233-7b04-40c1-b98c-74397c784f91 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.396008 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545b233-7b04-40c1-b98c-74397c784f91 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.398877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 429/824] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:04.403843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545b233-7b04-40c1-b98c-74397c784f91 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:04.447651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a032d93-4e92-44ca-9c08-bfd5ea4750bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:04.449263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a032d93-4e92-44ca-9c08-bfd5ea4750bb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:04.550014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:04.569443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 396/825] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:36:04.570776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed07bd-fb8b-4b61-963b-250d1a03b35a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.571062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed07bd-fb8b-4b61-963b-250d1a03b35a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.571766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed07bd-fb8b-4b61-963b-250d1a03b35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.577796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545b233-7b04-40c1-b98c-74397c784f91 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:04.590860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-26ed07bd-fb8b-4b61-963b-250d1a03b35a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:04.592091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-26ed07bd-fb8b-4b61-963b-250d1a03b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:04.631976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5c752-01d1-42d7-83b1-2f4ca385b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:04.632614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5c752-01d1-42d7-83b1-2f4ca385b43e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.632891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5c752-01d1-42d7-83b1-2f4ca385b43e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.633166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5c752-01d1-42d7-83b1-2f4ca385b43e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.640619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5c752-01d1-42d7-83b1-2f4ca385b43e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:04.642338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5c752-01d1-42d7-83b1-2f4ca385b43e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:04.652900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e5f5c752-01d1-42d7-83b1-2f4ca385b43e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:04.656144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:04.657167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 430/826] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c93e5-e275-4278-a3a7-00f33d6d48e1 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.659637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c93e5-e275-4278-a3a7-00f33d6d48e1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.666477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c93e5-e275-4278-a3a7-00f33d6d48e1 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.666477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 431/827] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:04.666477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c93e5-e275-4278-a3a7-00f33d6d48e1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:04.690338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 397/828] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:04.691545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed07bd-fb8b-4b61-963b-250d1a03b35a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:04.835069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed07bd-fb8b-4b61-963b-250d1a03b35a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:04.836074 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c93e5-e275-4278-a3a7-00f33d6d48e1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:04.880567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41729d64-4d0c-4e89-b2ba-d451fbc32009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:04.881388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41729d64-4d0c-4e89-b2ba-d451fbc32009 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.881833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41729d64-4d0c-4e89-b2ba-d451fbc32009 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.882242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41729d64-4d0c-4e89-b2ba-d451fbc32009 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.883268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41729d64-4d0c-4e89-b2ba-d451fbc32009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:04.883720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41729d64-4d0c-4e89-b2ba-d451fbc32009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:04.885792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41729d64-4d0c-4e89-b2ba-d451fbc32009 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:04.897896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:04.898864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.899361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.899851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.902055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 398/829] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:04.904809 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100bba-b483-4de8-b2c1-44c565986669 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:04.905318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100bba-b483-4de8-b2c1-44c565986669 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:04.905817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100bba-b483-4de8-b2c1-44c565986669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:04.927497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:04.929499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3d100bba-b483-4de8-b2c1-44c565986669 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:04.930372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:04.931076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3d100bba-b483-4de8-b2c1-44c565986669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:04.943237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:04.960917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:04.962557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:04.964427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:04.964427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:04.964427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:04.965759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 432/830] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:04.966657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:04.982381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:05.053630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 399/831] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:05.053630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d100bba-b483-4de8-b2c1-44c565986669 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:05.117556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d0d39-f30f-4155-b858-5ff20b71e5e9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:05.177629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bafc7-f240-4127-b097-cb48a4563e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:05.178638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bafc7-f240-4127-b097-cb48a4563e54 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:05.179082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bafc7-f240-4127-b097-cb48a4563e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:05.179528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bafc7-f240-4127-b097-cb48a4563e54 None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/da6017ad9ed5432f91dcb909b72f9a84/roles/361ada32137e4db3aa12e6776e5789d7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:05.191680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d100bba-b483-4de8-b2c1-44c565986669 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:05.198876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bafc7-f240-4127-b097-cb48a4563e54 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=da6017ad9ed5432f91dcb909b72f9a84, role_id=361ada32137e4db3aa12e6776e5789d7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:05.200348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bafc7-f240-4127-b097-cb48a4563e54 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:05.219869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 433/832] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:36:04 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/da6017ad9ed5432f91dcb909b72f9a84/roles/361ada32137e4db3aa12e6776e5789d7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:36:05.221586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bafc7-f240-4127-b097-cb48a4563e54 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:05.278264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:05.279343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:05.279847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:05.280328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:05.282014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:05.284221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:05.301423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:05.303484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:05.305251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 400/833] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:05.310815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:05.343688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:05.364817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:05.450191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bafc7-f240-4127-b097-cb48a4563e54 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:05.491788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25551-5c4b-41c3-9570-4a4dbb92fd5c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:05.513138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:05.514152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:05.514558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:05.515014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:05.516110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:05.516529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:05.519366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:05.540774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 434/834] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:05.541875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:05.559377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:05.560363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:05.560824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:05.561262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:05.562135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:05.562637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:05.565640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:05.580418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 401/835] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:05.580418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:05.740300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:05.740591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437f15-3c22-4d88-9354-ec786d9f8785 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:05.746931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e66fee-c216-48bc-acde-a1f193ac284d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:05.762189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:05.805148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:05.806144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:05.806604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:05.807065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:05.812191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02c3da-3017-449b-96cf-c087049e93d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:05.813303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02c3da-3017-449b-96cf-c087049e93d0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:05.813792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02c3da-3017-449b-96cf-c087049e93d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:05.814295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02c3da-3017-449b-96cf-c087049e93d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:05.820633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:05.823346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:05.836253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02c3da-3017-449b-96cf-c087049e93d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:05.844375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:05.854645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:05.858797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:05.858797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:05.858797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:05.858797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:05.858797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:05.858797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:05.858797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:05.858797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0c02c3da-3017-449b-96cf-c087049e93d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:05.859797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:05.862374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:05.864306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:05.865808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 402/836] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:05.865808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:05.866087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 435/837] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:05.866087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02c3da-3017-449b-96cf-c087049e93d0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:06.036449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c63cc3-4a10-4223-9c9f-b4e6464fa87c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:06.038256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02c3da-3017-449b-96cf-c087049e93d0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:06.076490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:06.077206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:06.077559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:06.077929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:06.078678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:06.079060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:06.080586 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:06.097649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 403/838] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:06.097649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:06.115199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:06.116891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:06.117457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:06.118020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:06.119697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:06.120304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:06.123258 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:06.144636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 436/839] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:06.146637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:06.151501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:06.211647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:06.315176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93454b3c-a424-40e2-aba3-4b165d3bda0d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:06.368154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf32d1-ed87-456d-9e4e-4bffc5b23c56 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:06.378645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:06.379634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:06.380157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:06.380637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:06.381853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:06.382365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:06.385041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:06.422011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 404/840] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:06.429042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:06.446273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:06.447549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:06.448161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:06.448762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:06.470007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:06.473177 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:06.501247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:06.503427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:06.505491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:06.505491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:06.505491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:06.505491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 437/841] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:06.511474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:06.617003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:06.662796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fdfd1-35ca-4618-ae33-024d133e4ff7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:06.687520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:06.717062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88642e00-c0d6-4af4-bcfb-93f1a1a1a8fe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:06.737762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:06.739113 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:06.739848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:06.740531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:06.742169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=175bb8ec9ccf487bb6e11f37bec82cb5) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:06.742933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:06.745893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:06.765642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 405/842] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:06 2022] GET /identity/v3/role_assignments?user.id=175bb8ec9ccf487bb6e11f37bec82cb5&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=b8bf66974c0448089a192ead432a35f2 => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:06.767109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:06.768358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:06.768638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:06.768906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:06.769629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:06.769963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:06.771479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:06.789195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 438/843] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:06.796932 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:07.003883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a4f7-4fef-432d-91a1-7af4c6f33dc3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:07.073755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:07.074948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:07.075442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:07.075950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:07.091136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:07.093870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:07.116798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:07.118036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:07.120008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 406/844] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:36:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:07.128816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:07.275835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2d692-f4a1-4929-be2c-7de1873a9eef None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:07.316273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d545cc-3d34-4d7f-8ce8-b5d55488ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:07.316894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d545cc-3d34-4d7f-8ce8-b5d55488ae62 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:07.317170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d545cc-3d34-4d7f-8ce8-b5d55488ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:07.317442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d545cc-3d34-4d7f-8ce8-b5d55488ae62 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:07.318462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d545cc-3d34-4d7f-8ce8-b5d55488ae62 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:07.318767 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d545cc-3d34-4d7f-8ce8-b5d55488ae62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:07.320364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d545cc-3d34-4d7f-8ce8-b5d55488ae62 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:07.336944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:07.343346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 439/845] 10.222.0.30 () {56 vars in 1135 bytes} [Tue Oct 4 12:36:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:07.349129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:07.359316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:07.530355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590f75f-c5fb-4181-8488-a8dd500cced9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:07.605114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf9e2-1512-429d-8511-8812cea6b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:07.606581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf9e2-1512-429d-8511-8812cea6b33d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:07.607579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf9e2-1512-429d-8511-8812cea6b33d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:07.608244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acf9e2-1512-429d-8511-8812cea6b33d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:07.670932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5571af-fe04-4808-9e7f-4a91c9c7c065 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:07.671209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5571af-fe04-4808-9e7f-4a91c9c7c065 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:07.671479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5571af-fe04-4808-9e7f-4a91c9c7c065 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:07.673187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 440/846] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:07.679692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b675d9-f9a1-4a9a-9689-92df9fc9585c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:07.679977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b675d9-f9a1-4a9a-9689-92df9fc9585c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:07.680254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b675d9-f9a1-4a9a-9689-92df9fc9585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:07.718860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e1b675d9-f9a1-4a9a-9689-92df9fc9585c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:07.723106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e1b675d9-f9a1-4a9a-9689-92df9fc9585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:07.724508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf9e2-1512-429d-8511-8812cea6b33d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:07.726019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acf9e2-1512-429d-8511-8812cea6b33d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:07.736751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:07.860943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 441/847] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:07.928339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 407/848] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:36:07.934785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b675d9-f9a1-4a9a-9689-92df9fc9585c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:08.103225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b675d9-f9a1-4a9a-9689-92df9fc9585c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:08.138640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:08.146376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:08.147933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:08.148229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:08.148496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:08.161364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:08.162992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:08.180202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:08.182444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:08.184146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:08.184146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:08.184146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:08.185888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 442/849] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:08.187483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf9e2-1512-429d-8511-8812cea6b33d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:08.331218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acf9e2-1512-429d-8511-8812cea6b33d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:08.346552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:08.362165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:08.381402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:08.382800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:08.383324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:08.383807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:08.384679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:08.385326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:08.386981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:08.400724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 408/850] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:08.410800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:08.526034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10250dbb-2281-4eca-9c98-05190f67da08 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:08.564773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b4ea0-b358-4f44-858a-7c624d82d738 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:08.566587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:08.567655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:08.568160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:08.568706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:08.576432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:08.578490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:08.592496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:08.593456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:08.594479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:08.594479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:08.594479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:08.594479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:08.594479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:08.594479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:08.594479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:08.594479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:08.597798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 409/851] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:08.607192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:08.624438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4a71-3368-48cd-96a0-c6a19ecffd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:08.625084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4a71-3368-48cd-96a0-c6a19ecffd53 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:08.625374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4a71-3368-48cd-96a0-c6a19ecffd53 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:08.625652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4a71-3368-48cd-96a0-c6a19ecffd53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:08.639528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b4a71-3368-48cd-96a0-c6a19ecffd53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-904b4a71-3368-48cd-96a0-c6a19ecffd53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:08.647129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:08.648400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:08.649199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 443/852] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:08.654977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4a71-3368-48cd-96a0-c6a19ecffd53 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:08.659685 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:08.743736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:08.747361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9cdf-b146-4c75-ae88-a53cb3375d7f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:08.789279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084813-09af-4266-a809-468a14716f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:08.790298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084813-09af-4266-a809-468a14716f97 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:08.790770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084813-09af-4266-a809-468a14716f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:08.791223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b084813-09af-4266-a809-468a14716f97 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:08.792175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084813-09af-4266-a809-468a14716f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:08.792669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084813-09af-4266-a809-468a14716f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:08.794453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b084813-09af-4266-a809-468a14716f97 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:08.808458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 410/853] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:08.819721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084813-09af-4266-a809-468a14716f97 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:08.862236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4a71-3368-48cd-96a0-c6a19ecffd53 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:08.925352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:08.926280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:08.926744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:08.927172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:08.928259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:08.928745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:08.930819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:08.932703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:08.950384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 444/854] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:08.951261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b084813-09af-4266-a809-468a14716f97 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:08.957637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:08.998056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:08.999112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:08.999597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.000062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.001029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=a5f678debf35484989502439a8780ba1) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:09.001555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:09.003875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:09.018367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 411/855] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:08 2022] GET /identity/v3/role_assignments?user.id=a5f678debf35484989502439a8780ba1&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=b8bf66974c0448089a192ead432a35f2 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:09.096994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aea0b-d23d-49e5-9912-6090883c4dcd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:09.100117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:09.150660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:09.151351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:09.151602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.151874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.166148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:09.167692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:09.185519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:09.186543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:09.187423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:09.187423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:09.187423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:09.187423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 445/856] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:09.194746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:09.334738 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede30a-c0f5-49f3-8170-aef8f4909648 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:09.402902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cc2bd-e5d5-4231-af68-2f29911137d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:09.404474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc2bd-e5d5-4231-af68-2f29911137d4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:09.405304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc2bd-e5d5-4231-af68-2f29911137d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.406108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cc2bd-e5d5-4231-af68-2f29911137d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.407609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cc2bd-e5d5-4231-af68-2f29911137d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:09.408419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cc2bd-e5d5-4231-af68-2f29911137d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:09.411332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cc2bd-e5d5-4231-af68-2f29911137d4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:09.436563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 412/857] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:09.446711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:09.591096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998db66-aa71-4a55-945b-2cefe7fbaa49 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:09.631311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307e01-006e-440e-a0c0-4caca1e2f9f0 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:09.631776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307e01-006e-440e-a0c0-4caca1e2f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.632251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307e01-006e-440e-a0c0-4caca1e2f9f0 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.634847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 413/858] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:36:09.636656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:09.641688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:09.641688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.641688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.646714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0646-1590-425f-b7ad-18ebea26773f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:09.647357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0646-1590-425f-b7ad-18ebea26773f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.648000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0646-1590-425f-b7ad-18ebea26773f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.653849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:09.656871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:09.680302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:09.681313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:09.682306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:09.683276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-40fe0646-1590-425f-b7ad-18ebea26773f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:09.683364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 446/859] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:36:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:09.687183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-40fe0646-1590-425f-b7ad-18ebea26773f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:09.691804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:09.695815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:09.739217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:09.818766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 414/860] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:09.820556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b736-1ce6-43dc-904f-bdd7f60e88e6 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:09.821081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b736-1ce6-43dc-904f-bdd7f60e88e6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.821559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b736-1ce6-43dc-904f-bdd7f60e88e6 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.823434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 415/861] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:09.832328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c653ec-29b9-4072-a33b-78cc6758f9d8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:09.832945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c653ec-29b9-4072-a33b-78cc6758f9d8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.833743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c653ec-29b9-4072-a33b-78cc6758f9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.858505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b9c653ec-29b9-4072-a33b-78cc6758f9d8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:09.860224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b9c653ec-29b9-4072-a33b-78cc6758f9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:09.900120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b15a-c0c8-4743-82de-ca41fc837212 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:09.940917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:09.942012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:09.942525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:09.943027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:09.944024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:09.944525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:09.946365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:09.973223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 447/862] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 4 12:36:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:09.975078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:10.002692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 416/863] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:10.059759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:10.088774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40de8c-9af5-416b-8829-60f85ff72f81 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:10.129390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4469-918e-4285-8cab-eff30983eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:10.130034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4469-918e-4285-8cab-eff30983eb86 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:10.130307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4469-918e-4285-8cab-eff30983eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:10.130582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f4469-918e-4285-8cab-eff30983eb86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:10.206889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f4469-918e-4285-8cab-eff30983eb86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:10.208266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f4469-918e-4285-8cab-eff30983eb86 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:10.292397 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:10.323231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 448/864] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:36:10.327996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c653ec-29b9-4072-a33b-78cc6758f9d8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:10.328828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4469-918e-4285-8cab-eff30983eb86 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:10.441486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:10.482918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c653ec-29b9-4072-a33b-78cc6758f9d8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:10.487335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f4469-918e-4285-8cab-eff30983eb86 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:10.522147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:10.522883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:10.523257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:10.523575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:10.524238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:10.525674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:10.529764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:10.530421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:10.530700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:10.530970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:10.536890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:10.542205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:10.543106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 417/865] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Oct 4 12:36:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:10.543885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:10.546634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:10.548175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:10.566516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:10.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:10.568387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:10.568387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:10.568387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:10.568555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 449/866] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:10.570010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:10.612974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:10.685652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c94b85-b9ca-4d52-873e-2a40ed386238 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:10.704330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de053-89ab-480e-8d6f-b65d61e4bc8f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:10.727013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e546aec-1082-4bab-b45a-7615d9cf1be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:10.727631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e546aec-1082-4bab-b45a-7615d9cf1be5 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:10.727912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e546aec-1082-4bab-b45a-7615d9cf1be5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:10.728305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e546aec-1082-4bab-b45a-7615d9cf1be5 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:10.728972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e546aec-1082-4bab-b45a-7615d9cf1be5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:10.730471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e546aec-1082-4bab-b45a-7615d9cf1be5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:10.734588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:10.746675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:10.747296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:10.747601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:10.747876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:10.748520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:10.748824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:10.750261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:10.752316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 418/867] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:36:10 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:10.753197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e546aec-1082-4bab-b45a-7615d9cf1be5 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:10.766635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 450/868] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:10.778941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:10.910027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e546aec-1082-4bab-b45a-7615d9cf1be5 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:10.935100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:10.947697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e98eb-404a-4b53-b456-b219211e877c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:10.957095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:10.958095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:10.958095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:10.958330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:10.959110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:10.959420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:10.961370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:10.979817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 419/869] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:10.980820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:10.992263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:10.993181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:10.993688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:10.994141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:10.994947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:10.995462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:10.997208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:11.003309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 451/870] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:11.041158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:11.108871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca93ee0-b8f8-4450-bbc4-b37221af45bf None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:11.150980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:11.151907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:11.152642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:11.153076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:11.161507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:11.163288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:11.176526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:11.177713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:11.178760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:11.178760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:11.178760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:11.178760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:11.178760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:11.178760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:11.178760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:11.178760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:11.180846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 420/871] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:11.189785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:11.356589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488eb9-92e5-4c1b-9e04-1f0366263790 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:11.429326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1627cc1-3cad-4b80-81ff-8ccaee2daa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:11.430073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1627cc1-3cad-4b80-81ff-8ccaee2daa3d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:11.430360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1627cc1-3cad-4b80-81ff-8ccaee2daa3d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:11.430638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1627cc1-3cad-4b80-81ff-8ccaee2daa3d None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:11.431357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1627cc1-3cad-4b80-81ff-8ccaee2daa3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:11.431665 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1627cc1-3cad-4b80-81ff-8ccaee2daa3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:11.433121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1627cc1-3cad-4b80-81ff-8ccaee2daa3d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:11.448435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 452/872] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:11.455359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:11.613749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71505b6-cae0-444d-8c8d-ce863f361daf None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:11.634045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:11.682718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b9567-b95e-4224-a58c-1e3402edb5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:11.683763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9567-b95e-4224-a58c-1e3402edb5d5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:11.684241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9567-b95e-4224-a58c-1e3402edb5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:11.684697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b9567-b95e-4224-a58c-1e3402edb5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:11.686088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b9567-b95e-4224-a58c-1e3402edb5d5 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=da6017ad9ed5432f91dcb909b72f9a84) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:11.686627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b9567-b95e-4224-a58c-1e3402edb5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:11.689914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b9567-b95e-4224-a58c-1e3402edb5d5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:11.702088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 421/873] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:11 2022] GET /identity/v3/role_assignments?user.id=da6017ad9ed5432f91dcb909b72f9a84&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:12.110547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888e86f-4900-4067-9862-746629aeaa49 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:12.111793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888e86f-4900-4067-9862-746629aeaa49 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:12.112408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888e86f-4900-4067-9862-746629aeaa49 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:12.115440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 453/874] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:12.125327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2515-84bc-4fb5-a442-56a9762cbee1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:12.126124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2515-84bc-4fb5-a442-56a9762cbee1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:12.126788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2515-84bc-4fb5-a442-56a9762cbee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:12.159446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-975f2515-84bc-4fb5-a442-56a9762cbee1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:12.161580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-975f2515-84bc-4fb5-a442-56a9762cbee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:12.301237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 422/875] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:12 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:12.806388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888e86f-4900-4067-9862-746629aeaa49 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:12.835579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:12.990142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888e86f-4900-4067-9862-746629aeaa49 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:13.027729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:13.028376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:13.028655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:13.028932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:13.029525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:13.030949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:13.040664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:13.041723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:13.042541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 454/876] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:13.053021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f2515-84bc-4fb5-a442-56a9762cbee1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:13.248337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f2515-84bc-4fb5-a442-56a9762cbee1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:13.253293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:13.312382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb187e3-27b4-4b0e-9ee4-bff311883bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:13.313418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb187e3-27b4-4b0e-9ee4-bff311883bfd None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:13.313952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb187e3-27b4-4b0e-9ee4-bff311883bfd None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:13.314979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb187e3-27b4-4b0e-9ee4-bff311883bfd None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:13.316099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb187e3-27b4-4b0e-9ee4-bff311883bfd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:13.316621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb187e3-27b4-4b0e-9ee4-bff311883bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:13.319199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb187e3-27b4-4b0e-9ee4-bff311883bfd None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:13.328203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 423/877] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:13.337536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:13.344333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dad61-4cb7-43f8-a76f-c05f899f3fac None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:13.344815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dad61-4cb7-43f8-a76f-c05f899f3fac None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:13.345319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dad61-4cb7-43f8-a76f-c05f899f3fac None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:13.348108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 424/878] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:13.354228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae32f4-2988-45d8-8f34-f5b3110ebd3f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:13.354702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae32f4-2988-45d8-8f34-f5b3110ebd3f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:13.355181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae32f4-2988-45d8-8f34-f5b3110ebd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:13.401344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8eae32f4-2988-45d8-8f34-f5b3110ebd3f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:13.403630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8eae32f4-2988-45d8-8f34-f5b3110ebd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:13.514137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:13.576327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151157fb-7030-4e33-b442-87f6f7c8fff9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:13.628587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 425/879] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:13.693466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefcb9c-0156-475a-a2f4-75cd23349a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:13.694551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefcb9c-0156-475a-a2f4-75cd23349a9d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:13.695032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefcb9c-0156-475a-a2f4-75cd23349a9d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:13.695501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefcb9c-0156-475a-a2f4-75cd23349a9d None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:13.696631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefcb9c-0156-475a-a2f4-75cd23349a9d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:13.697151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefcb9c-0156-475a-a2f4-75cd23349a9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:13.699837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefcb9c-0156-475a-a2f4-75cd23349a9d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:13.716231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 455/880] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:14.109407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7326-c663-4885-9483-9529b7d3f480 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:14.110273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7326-c663-4885-9483-9529b7d3f480 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:14.110273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7326-c663-4885-9483-9529b7d3f480 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:14.112336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 426/881] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:14.118455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdec1f-ffcc-4a99-8abe-2d7e8d6a807f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:14.119285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdec1f-ffcc-4a99-8abe-2d7e8d6a807f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:14.119285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdec1f-ffcc-4a99-8abe-2d7e8d6a807f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:14.139759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-84bdec1f-ffcc-4a99-8abe-2d7e8d6a807f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:14.141023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-84bdec1f-ffcc-4a99-8abe-2d7e8d6a807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:14.226825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 456/882] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:14 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:14.293695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7326-c663-4885-9483-9529b7d3f480 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:14.301813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e04ca-d31f-4045-adb6-a2b172b1ce79 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:14.302110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e04ca-d31f-4045-adb6-a2b172b1ce79 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:14.302386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e04ca-d31f-4045-adb6-a2b172b1ce79 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:14.304077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 457/883] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:36:14.309706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d64f02-6038-43df-b0db-408de107fde0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:14.309990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d64f02-6038-43df-b0db-408de107fde0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:14.310269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d64f02-6038-43df-b0db-408de107fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:14.331661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-64d64f02-6038-43df-b0db-408de107fde0 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:14.332893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-64d64f02-6038-43df-b0db-408de107fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:14.428461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7326-c663-4885-9483-9529b7d3f480 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:14.428760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 458/884] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:14 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:14.431748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:14.468440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:14.469090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:14.469370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:14.469663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:14.470793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:14.472199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:14.481910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:14.483049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:14.483901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 427/885] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:14.490283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d64f02-6038-43df-b0db-408de107fde0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:14.493268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:14.524135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:14.653878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2fc01-03bf-4d21-9f6c-2fe07bbab02b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:14.670548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d64f02-6038-43df-b0db-408de107fde0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:14.692102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fcac8-595d-42a1-9284-49c1853dede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:14.692756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fcac8-595d-42a1-9284-49c1853dede3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:14.693038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fcac8-595d-42a1-9284-49c1853dede3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:14.693314 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fcac8-595d-42a1-9284-49c1853dede3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:14.705881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fcac8-595d-42a1-9284-49c1853dede3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-535fcac8-595d-42a1-9284-49c1853dede3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:14.711576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:14.712656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:14.713472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 428/886] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 4 12:36:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:14.714225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fcac8-595d-42a1-9284-49c1853dede3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:14.736647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:14.737695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:14.738140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:14.738569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:14.739603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:14.740128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:14.741843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:14.742649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:14.751951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 459/887] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:14.753490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:14.839422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fcac8-595d-42a1-9284-49c1853dede3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:14.879477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ff631-7703-4ddb-9fee-0de1f7c81efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:14.880111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ff631-7703-4ddb-9fee-0de1f7c81efb None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:14.880394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ff631-7703-4ddb-9fee-0de1f7c81efb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:14.880669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ff631-7703-4ddb-9fee-0de1f7c81efb None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:14.881374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ff631-7703-4ddb-9fee-0de1f7c81efb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:14.882858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ff631-7703-4ddb-9fee-0de1f7c81efb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:14.886455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:14.900621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 429/888] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:36:14 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:14.901827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ff631-7703-4ddb-9fee-0de1f7c81efb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:14.963823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fafd5-6dcf-4f8b-b18a-8a74aee462ae None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:15.015359 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:15.016467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:15.016978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:15.017563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:15.018538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:15.019212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:15.021109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:15.036094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 460/889] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 4 12:36:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:15.042869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:15.050649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:15.083385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ff631-7703-4ddb-9fee-0de1f7c81efb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:15.144088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:15.145775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:15.146299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:15.147044 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:15.148515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:15.149021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:15.151070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:15.160468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 430/890] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:15.167033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:15.177106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf523be4-aff0-4661-b63d-bbdfebc9f057 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:15.206821 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:15.229854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:15.230432 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:15.230715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:15.230992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:15.246663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:15.247660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:15.264169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:15.265162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:15.266118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:15.266118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:15.266118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:15.266118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 461/891] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:15.274170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:15.331972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71808c5-c34b-4e4a-a209-fdd0183f1139 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:15.374156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:15.374792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:15.375073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:15.375348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:15.376077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] RBAC: Adding query filter params (interface=public, service_id=cae62c5d3cf34b809d52e102bb0e95ae, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:15.376386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:15.378082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:15.389009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 431/892] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 4 12:36:15 2022] GET /identity/v3/endpoints?service_id=cae62c5d3cf34b809d52e102bb0e95ae&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:15.390209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:15.418620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:15.451523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56360a-916b-471e-8633-40fd01fbf497 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:15.513956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:15.514889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:15.515485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:15.515838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:15.516981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:15.518071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:15.521064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:15.546663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 462/893] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:15.552385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:15.567552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308f5e9-107b-4a5a-993a-f5aa0b532366 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:15.601115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:15.616221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aaec5-f57a-4b6f-ba6b-6c2dcb876d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:15.616856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aaec5-f57a-4b6f-ba6b-6c2dcb876d5f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:15.617136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aaec5-f57a-4b6f-ba6b-6c2dcb876d5f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:15.617411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aaec5-f57a-4b6f-ba6b-6c2dcb876d5f None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:15.618265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aaec5-f57a-4b6f-ba6b-6c2dcb876d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:15.620427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aaec5-f57a-4b6f-ba6b-6c2dcb876d5f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:15.636904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 432/894] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:36:15 2022] GET /identity/v3/services => generated 1268 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:36:15.688549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ccfea-1fa3-4604-ba2d-489140e3fecc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:15.732737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:15.733408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:15.733738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:15.734010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:15.742992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:15.744539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:15.758782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:15.759782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:15.760740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 463/895] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:36:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:15.766680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aaec5-f57a-4b6f-ba6b-6c2dcb876d5f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:15.865921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:15.918684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aaec5-f57a-4b6f-ba6b-6c2dcb876d5f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:15.982597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:15.983642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:15.984128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:15.984592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:15.986431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:15.986950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:15.989635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:16.023608 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 433/896] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 4 12:36:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:16.029076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:16.133685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:16.145428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435bf34-c19a-4c3a-8c81-19839c91e72a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:16.184186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaa054-d47b-42ea-a6b5-f52700a36112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:16.185679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaa054-d47b-42ea-a6b5-f52700a36112 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:16.186326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaa054-d47b-42ea-a6b5-f52700a36112 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:16.186799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaa054-d47b-42ea-a6b5-f52700a36112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:16.262423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaa054-d47b-42ea-a6b5-f52700a36112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:16.264468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaa054-d47b-42ea-a6b5-f52700a36112 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:16.371979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:16.383877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 464/897] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:16 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:36:16.385550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:16.529879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec4447-60b2-464a-be26-4ea7b5a56ac8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:16.565425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:16.571839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:16.572490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:16.572770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:16.573045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:16.585223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:16.586762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:16.603814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:16.605668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:16.607524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:16.607524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:16.607524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:16.607524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 434/898] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:16.611696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaa054-d47b-42ea-a6b5-f52700a36112 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:16.727786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaa054-d47b-42ea-a6b5-f52700a36112 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:16.768209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:16.768992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:16.769301 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:16.769554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:16.770278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:16.770581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:16.772000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:16.786013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 465/899] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:16.792609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:16.945363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12e8e8-3e71-43e8-8fa7-9380128735b7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:17.013168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:17.014233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:17.014726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:17.015215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:17.029466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:17.032218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:17.055353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:17.056315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:17.057176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:17.057176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:17.057176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:17.057176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:17.057176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:17.057176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:17.057176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:17.057176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:17.058089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 435/900] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:17.064229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:17.139675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:17.180523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc5f7b-48a8-4682-a554-33f6eeebd4fb None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:17.219472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca4b4b-fb68-408a-848b-18dcf8a42e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:17.220472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4b4b-fb68-408a-848b-18dcf8a42e61 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:17.220472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4b4b-fb68-408a-848b-18dcf8a42e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:17.220701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca4b4b-fb68-408a-848b-18dcf8a42e61 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:17.221372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca4b4b-fb68-408a-848b-18dcf8a42e61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:17.221712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca4b4b-fb68-408a-848b-18dcf8a42e61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:17.223200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca4b4b-fb68-408a-848b-18dcf8a42e61 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:17.237635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 466/901] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:17.243909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:17.318838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:17.333202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47aaff-c97f-4537-b4df-370bb7fbf80f None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:17.333650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47aaff-c97f-4537-b4df-370bb7fbf80f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:17.333802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47aaff-c97f-4537-b4df-370bb7fbf80f None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:17.335568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 467/902] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:17.344591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665741-1848-4542-ad82-cb69787b7429 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:17.345535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665741-1848-4542-ad82-cb69787b7429 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:17.346336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6665741-1848-4542-ad82-cb69787b7429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:17.377831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a6665741-1848-4542-ad82-cb69787b7429 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:17.379898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a6665741-1848-4542-ad82-cb69787b7429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:17.442835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0deb95-e92a-4857-9b57-84d34b7d56cb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:17.521863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 468/903] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:17.523881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14761f23-339a-49ec-8088-7ee776242206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:17.525027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761f23-339a-49ec-8088-7ee776242206 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:17.525537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761f23-339a-49ec-8088-7ee776242206 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:17.526075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14761f23-339a-49ec-8088-7ee776242206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:17.527724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761f23-339a-49ec-8088-7ee776242206 None admin] RBAC: Adding query filter params (role.id=afda32e5fe2649aa9e427ff8657c62e0, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=da6017ad9ed5432f91dcb909b72f9a84) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:17.528282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761f23-339a-49ec-8088-7ee776242206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:17.531066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14761f23-339a-49ec-8088-7ee776242206 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:17.542579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 436/904] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:17 2022] GET /identity/v3/role_assignments?user.id=da6017ad9ed5432f91dcb909b72f9a84&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=afda32e5fe2649aa9e427ff8657c62e0 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:18.021695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6665741-1848-4542-ad82-cb69787b7429 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:18.112826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:18.226664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6665741-1848-4542-ad82-cb69787b7429 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:18.292010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ee1ab-fa12-4b45-89ca-2f6c53164cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:18.292844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee1ab-fa12-4b45-89ca-2f6c53164cd7 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:18.293271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee1ab-fa12-4b45-89ca-2f6c53164cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:18.293722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee1ab-fa12-4b45-89ca-2f6c53164cd7 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:18.294825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee1ab-fa12-4b45-89ca-2f6c53164cd7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:18.297157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee1ab-fa12-4b45-89ca-2f6c53164cd7 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:18.328050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 469/905] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:36:18 2022] POST /identity/v3/services => generated 241 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:18.386788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1b36-d1d1-40e4-adc6-0057f0d8e010 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:18.387294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1b36-d1d1-40e4-adc6-0057f0d8e010 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:18.387850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f1b36-d1d1-40e4-adc6-0057f0d8e010 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:18.391125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 437/906] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:18.401834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b2fb-a7b1-4bbc-ae69-bf5be3b78d46 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:18.402583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b2fb-a7b1-4bbc-ae69-bf5be3b78d46 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:18.403150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094b2fb-a7b1-4bbc-ae69-bf5be3b78d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:18.446506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1094b2fb-a7b1-4bbc-ae69-bf5be3b78d46 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:18.448911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1094b2fb-a7b1-4bbc-ae69-bf5be3b78d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:18.606096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 470/907] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:18.912576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1b36-d1d1-40e4-adc6-0057f0d8e010 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:19.037108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f1b36-d1d1-40e4-adc6-0057f0d8e010 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:19.048724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:19.077131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc798-dd4c-42f0-a046-46cdacfe1c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:19.077810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc798-dd4c-42f0-a046-46cdacfe1c09 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:19.078084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc798-dd4c-42f0-a046-46cdacfe1c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:19.078357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc798-dd4c-42f0-a046-46cdacfe1c09 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:19.078946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fc798-dd4c-42f0-a046-46cdacfe1c09 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:19.080878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fc798-dd4c-42f0-a046-46cdacfe1c09 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-4a2fc798-dd4c-42f0-a046-46cdacfe1c09 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:19.090758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:19.093081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:19.096286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 438/908] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Oct 4 12:36:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:19.101635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094b2fb-a7b1-4bbc-ae69-bf5be3b78d46 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:19.144621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:19.190349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d70994-fd78-424a-9581-1c912d6e6528 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:19.190743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d70994-fd78-424a-9581-1c912d6e6528 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:19.191216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d70994-fd78-424a-9581-1c912d6e6528 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:19.200190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 439/909] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:36:19.202424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db822-006b-4f36-aeef-32d68226e48a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:19.202884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db822-006b-4f36-aeef-32d68226e48a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:19.203337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7db822-006b-4f36-aeef-32d68226e48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:19.235284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094b2fb-a7b1-4bbc-ae69-bf5be3b78d46 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:19.235877 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5f7db822-006b-4f36-aeef-32d68226e48a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:19.237716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5f7db822-006b-4f36-aeef-32d68226e48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:19.279406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:19.280573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:19.281182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:19.281707 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:19.282580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:19.283675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:19.285953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:19.293088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 471/910] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:19.299306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:19.360905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 440/911] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:19.481200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:19.496185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4d3b6-c413-458a-b868-ed0fa2cba879 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:19.565788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890cf09-6fef-4acd-9816-961c98c34f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:19.566857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cf09-6fef-4acd-9816-961c98c34f07 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:19.567326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cf09-6fef-4acd-9816-961c98c34f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:19.567893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cf09-6fef-4acd-9816-961c98c34f07 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:19.569054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890cf09-6fef-4acd-9816-961c98c34f07 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:19.569571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890cf09-6fef-4acd-9816-961c98c34f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:19.572193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890cf09-6fef-4acd-9816-961c98c34f07 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:19.582554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 472/912] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:19.588944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7db822-006b-4f36-aeef-32d68226e48a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:19.709372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7db822-006b-4f36-aeef-32d68226e48a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:19.711436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:19.763599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395455f4-5ec0-45c0-94ce-295ecc866540 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:19.763779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395455f4-5ec0-45c0-94ce-295ecc866540 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:19.764055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395455f4-5ec0-45c0-94ce-295ecc866540 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:19.765793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 473/913] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:36:19.771746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698f45-8715-4ee2-bc9b-1e39bb8aeb85 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:19.772074 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698f45-8715-4ee2-bc9b-1e39bb8aeb85 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:19.772292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698f45-8715-4ee2-bc9b-1e39bb8aeb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:19.775892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:19.776917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:19.777713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:19.778060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:19.778866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] RBAC: Adding query filter params (interface=public, service_id=7d04acec3b5f4476a3372df88f79a311, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:19.779339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:19.781237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:19.794009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 441/914] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 4 12:36:19 2022] GET /identity/v3/endpoints?service_id=7d04acec3b5f4476a3372df88f79a311&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:19.797995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bd698f45-8715-4ee2-bc9b-1e39bb8aeb85 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:19.800286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:19.800826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bd698f45-8715-4ee2-bc9b-1e39bb8aeb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:19.895159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 474/915] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:19.896097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698f45-8715-4ee2-bc9b-1e39bb8aeb85 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:19.990527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc177a6-4e1c-46f7-937a-220a9a6c3b74 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:20.032544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf4cfe-d720-4c43-8d7d-16e96408ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:20.034300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4cfe-d720-4c43-8d7d-16e96408ab57 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:20.034840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4cfe-d720-4c43-8d7d-16e96408ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:20.035337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf4cfe-d720-4c43-8d7d-16e96408ab57 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:20.036208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf4cfe-d720-4c43-8d7d-16e96408ab57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:20.037994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf4cfe-d720-4c43-8d7d-16e96408ab57 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:20.045790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 442/916] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:36:19 2022] GET /identity/v3/services => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:36:20.076255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:20.089844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698f45-8715-4ee2-bc9b-1e39bb8aeb85 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:20.136794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:20.137459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:20.137816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:20.138097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:20.138714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:20.140169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:20.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:20.153104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:20.154671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 475/917] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:20.159505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf4cfe-d720-4c43-8d7d-16e96408ab57 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:20.208629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:20.356068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf4cfe-d720-4c43-8d7d-16e96408ab57 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:20.406104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:20.419239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:20.420279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:20.424884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:20.424884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:20.424884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:20.424884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:20.425497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:20.435042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 443/918] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:20.441736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:20.562484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3557ca-730e-4b17-acea-22eff1d65b58 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:20.603379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7df61-68d7-4ca1-91d3-bfc2995c69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:20.604030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7df61-68d7-4ca1-91d3-bfc2995c69ba None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:20.604920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7df61-68d7-4ca1-91d3-bfc2995c69ba None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:20.605188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7df61-68d7-4ca1-91d3-bfc2995c69ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:20.618667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7df61-68d7-4ca1-91d3-bfc2995c69ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:20.622192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e7d7df61-68d7-4ca1-91d3-bfc2995c69ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:20.624054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:20.626163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:20.628254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 476/919] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 4 12:36:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:20.632441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce674ae3-66d9-44ee-ae73-9a50ce38244d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:20.640718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7df61-68d7-4ca1-91d3-bfc2995c69ba None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:20.670136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:20.678004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:20.678636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:20.678925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:20.679188 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:20.679854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:20.680158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:20.682060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:20.692785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 444/920] 10.222.0.30 () {56 vars in 1114 bytes} [Tue Oct 4 12:36:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:20.693933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:20.856847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7df61-68d7-4ca1-91d3-bfc2995c69ba None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:20.915230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acfe96-3159-4943-89f1-d3d26da2ecd3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:20.926873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:20.928350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:20.929119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:20.929894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:20.931566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:20.932393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:20.935416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:20.957540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 477/921] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 4 12:36:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:20.962813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:20.986623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafc3df-9c6b-4321-846d-62fa742e4cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:20.987447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafc3df-9c6b-4321-846d-62fa742e4cbc None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:20.987961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafc3df-9c6b-4321-846d-62fa742e4cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:20.988465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafc3df-9c6b-4321-846d-62fa742e4cbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:20.989756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafc3df-9c6b-4321-846d-62fa742e4cbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:20.992786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafc3df-9c6b-4321-846d-62fa742e4cbc None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:21.037692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 445/922] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:36:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:21.147566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:21.200163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbb969-8a39-4554-8048-8b2bb849e0ae None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:21.282450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d4f76-1e84-4410-838a-d7ba0bf6d03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:21.284117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d4f76-1e84-4410-838a-d7ba0bf6d03c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:21.284616 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d4f76-1e84-4410-838a-d7ba0bf6d03c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:21.285189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d4f76-1e84-4410-838a-d7ba0bf6d03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:21.306527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d4f76-1e84-4410-838a-d7ba0bf6d03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:21.309582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d4f76-1e84-4410-838a-d7ba0bf6d03c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-753d4f76-1e84-4410-838a-d7ba0bf6d03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:21.338981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:21.340833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:21.342593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:21.342593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:21.342593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:21.342593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 478/923] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:21.354545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafc3df-9c6b-4321-846d-62fa742e4cbc None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:21.371787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d3d3-38eb-4163-92c0-e69094e8ccda None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:21.372236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d3d3-38eb-4163-92c0-e69094e8ccda None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:21.372710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d3d3-38eb-4163-92c0-e69094e8ccda None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:21.376932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 479/924] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:21.383790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037040b-df77-4813-ad1d-b3e678f4d2d1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:21.384668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037040b-df77-4813-ad1d-b3e678f4d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:21.385481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037040b-df77-4813-ad1d-b3e678f4d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:21.387038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:21.440979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f037040b-df77-4813-ad1d-b3e678f4d2d1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:21.443969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f037040b-df77-4813-ad1d-b3e678f4d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:21.561777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafc3df-9c6b-4321-846d-62fa742e4cbc None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:21.570943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 480/925] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:21.630525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:21.631906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:21.632579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:21.633214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:21.634667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:21.635459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:21.638298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:21.663027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 446/926] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:21.672138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037040b-df77-4813-ad1d-b3e678f4d2d1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:21.773250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:21.864567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037040b-df77-4813-ad1d-b3e678f4d2d1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:21.937072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:21.938143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:21.938684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:21.939111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:21.954039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:21.956889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:21.980244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:21.982173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:21.983482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 481/927] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:36:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:21.994010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:22.146496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:22.154191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:22.203557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4138b9d-f4f3-46cb-9577-30faec62f8c7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:22.272343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:22.274014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:22.274857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:22.275640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:22.277514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cbfc9-41f3-4cea-a80d-b728d79dfa6e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:22.278048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:22.278725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:22.281749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:22.294784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:22.317344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:22.318036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:22.318295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:22.318559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:22.319156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:22.320544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:22.330499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 447/928] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 4 12:36:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:22.335331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:22.335582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:22.337071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:22.339325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 482/929] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:22.352865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:22.559225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2bef9-5858-4cb5-8ad5-b6e8a6c54fcb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:22.562507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda82df-0a83-4fc1-b21a-19e928ef9a79 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:22.608013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:22.619824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:22.621641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:22.622472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:22.623405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:22.631236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:22.632225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:22.632697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:22.633160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:22.634324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:22.634833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:22.637343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:22.651952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 483/930] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:22.652500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:22.655986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:22.657629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:22.690232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:22.692068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:22.694702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:22.694702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:22.694702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:22.697752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 448/931] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:22.703144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:22.763236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:22.894844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a8aec-16fe-41c5-8fca-087a0b2410b1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:22.920280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d9c60-0f37-422e-ac75-3e0e9c3233ff None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:22.968493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:22.970556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:22.971550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:22.972335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:22.974028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:22.974947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:22.979389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:22.987053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774859-4586-4014-9288-5a27b034132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:22.988292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774859-4586-4014-9288-5a27b034132e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:22.988865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774859-4586-4014-9288-5a27b034132e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:22.989519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774859-4586-4014-9288-5a27b034132e None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:22.990883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9774859-4586-4014-9288-5a27b034132e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:22.991496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9774859-4586-4014-9288-5a27b034132e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:23.002327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9774859-4586-4014-9288-5a27b034132e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:23.003512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 484/932] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:23.006065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:23.026885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 449/933] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:23.031195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774859-4586-4014-9288-5a27b034132e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:23.121786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:23.203896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bac1b-006b-4719-b5ab-3aace8d8447a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:23.221107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:23.221322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774859-4586-4014-9288-5a27b034132e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:23.264832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1763df-bff1-4f2e-a508-96d6b8706b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:23.265950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1763df-bff1-4f2e-a508-96d6b8706b6f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.266448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1763df-bff1-4f2e-a508-96d6b8706b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.266961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1763df-bff1-4f2e-a508-96d6b8706b6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.268651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1763df-bff1-4f2e-a508-96d6b8706b6f None admin] RBAC: Adding query filter params (interface=public, service_id=424b172c42fa40e69dc6062e4a863c96, region_id=RegionOne) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:23.269143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1763df-bff1-4f2e-a508-96d6b8706b6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:23.272540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1763df-bff1-4f2e-a508-96d6b8706b6f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:23.283354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572865f-5877-44d0-8e10-74765e75b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:23.284407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572865f-5877-44d0-8e10-74765e75b88d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.284859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572865f-5877-44d0-8e10-74765e75b88d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.285322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572865f-5877-44d0-8e10-74765e75b88d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.287614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 485/934] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 4 12:36:23 2022] GET /identity/v3/endpoints?service_id=424b172c42fa40e69dc6062e4a863c96&interface=public®ion_id=RegionOne => generated 194 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:23.289960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55866f-c61b-43d0-b14c-a0390ffe66a5 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.290452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55866f-c61b-43d0-b14c-a0390ffe66a5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.290924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55866f-c61b-43d0-b14c-a0390ffe66a5 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.293669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 486/935] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:23.297260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55866f-c61b-43d0-b14c-a0390ffe66a5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:23.304867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572865f-5877-44d0-8e10-74765e75b88d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:23.306462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572865f-5877-44d0-8e10-74765e75b88d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a572865f-5877-44d0-8e10-74765e75b88d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:23.320127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:23.322169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 450/936] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281a3a1-364e-4a78-b61c-fc12f76cece4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.323855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281a3a1-364e-4a78-b61c-fc12f76cece4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.324800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281a3a1-364e-4a78-b61c-fc12f76cece4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.349946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4281a3a1-364e-4a78-b61c-fc12f76cece4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:23.352152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4281a3a1-364e-4a78-b61c-fc12f76cece4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:23.460496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 451/937] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:23.461392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281a3a1-364e-4a78-b61c-fc12f76cece4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:23.490480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55866f-c61b-43d0-b14c-a0390ffe66a5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:23.502792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:23.540345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63522536-a6a7-42ba-9265-c1343199771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:23.541340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522536-a6a7-42ba-9265-c1343199771c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.541803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522536-a6a7-42ba-9265-c1343199771c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.542224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63522536-a6a7-42ba-9265-c1343199771c None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.543010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63522536-a6a7-42ba-9265-c1343199771c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:23.544949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63522536-a6a7-42ba-9265-c1343199771c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:23.551855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 487/938] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:36:23 2022] GET /identity/v3/services => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:36:23.553131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32ca9-b992-4cc2-b5bc-3832ceb6ef31 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.553541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32ca9-b992-4cc2-b5bc-3832ceb6ef31 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.553755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c32ca9-b992-4cc2-b5bc-3832ceb6ef31 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.565836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 488/939] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:23.565836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c821-10ae-4615-aae0-67a231ce8d42 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.565836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c821-10ae-4615-aae0-67a231ce8d42 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.565836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08c821-10ae-4615-aae0-67a231ce8d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.584692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ee08c821-10ae-4615-aae0-67a231ce8d42 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:23.586198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ee08c821-10ae-4615-aae0-67a231ce8d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:23.620108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281a3a1-364e-4a78-b61c-fc12f76cece4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:23.621185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:23.680955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 489/940] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:23.690907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:23.692513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.693280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.694110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.695764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:23.696662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:23.699801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:23.726355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 452/941] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:23.733483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c821-10ae-4615-aae0-67a231ce8d42 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:23.916863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08c821-10ae-4615-aae0-67a231ce8d42 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:23.960985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:23.976111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a21a-98a8-49e3-a849-29837872ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:23.976789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a21a-98a8-49e3-a849-29837872ad70 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:23.977066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a21a-98a8-49e3-a849-29837872ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:23.977336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a21a-98a8-49e3-a849-29837872ad70 None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/da6017ad9ed5432f91dcb909b72f9a84/roles/afda32e5fe2649aa9e427ff8657c62e0` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:23.979665 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8a21a-98a8-49e3-a849-29837872ad70 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=da6017ad9ed5432f91dcb909b72f9a84, role_id=afda32e5fe2649aa9e427ff8657c62e0)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:23.981125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8a21a-98a8-49e3-a849-29837872ad70 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:24.004353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 490/942] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:36:23 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/da6017ad9ed5432f91dcb909b72f9a84/roles/afda32e5fe2649aa9e427ff8657c62e0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:36:24.006353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a21a-98a8-49e3-a849-29837872ad70 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:24.066704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:24.191154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc257d-7d25-4b56-9b23-c36e0b86fecb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:24.199525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:24.248543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a21a-98a8-49e3-a849-29837872ad70 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:24.269105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:24.270174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:24.270665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:24.271337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:24.272405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:24.275272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:24.280376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING keystone.server.flask.common [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 12:36:24.302164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:24.302822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:24.303103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:24.303378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:24.303971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:24.305382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:24.315996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.sql.core [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 12:36:24.315996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 12:36:24.315996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [parameters: {'id': '1dd46fad637d4bd9bfca01c84f71954b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 12:36:24.315996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88338) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:24.326422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:24.328242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 12:36:24.330073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dd46fad637d4bd9bfca01c84f71954b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dd46fad637d4bd9bfca01c84f71954b. Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application conn.query(q) Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 12:36:24.333566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result.read() Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 12:36:24.335572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application next(self.gen) Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application yield resource Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application next(self.gen) Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise self.value Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application session.commit() Oct 04 12:36:24.337746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.session.flush() Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application compat.raise_( Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 12:36:24.342098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 12:36:24.347403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application conn.query(q) Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application result.read() Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 12:36:24.350411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [parameters: {'id': '1dd46fad637d4bd9bfca01c84f71954b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:24.354555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:24.358400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dd46fad637d4bd9bfca01c84f71954b. Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:24.363022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 453/943] 10.222.0.30 () {60 vars in 1140 bytes} [Tue Oct 4 12:36:23 2022] POST /identity/v3/projects => generated 262 bytes in 374 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:24.364920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 491/944] 10.222.0.30 () {56 vars in 1132 bytes} [Tue Oct 4 12:36:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:24.365146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:24.365357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:24.542971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:24.563406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150da6a8-4bdc-4f9a-93da-b81032ce69eb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:24.567997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216f399-1bb2-470b-9a78-1289f09fbbca None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:24.632149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:24.634004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:24.634795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:24.635577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:24.641947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:24.641947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:24.641947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:24.641947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:24.642857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:24.642857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:24.645334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:24.649058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:24.651158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:24.657672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 492/945] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:24.661117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:24.684971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:24.686955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:24.689472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:24.689472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:24.689472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:24.689472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:24.689472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:24.689472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:24.689472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:24.689472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:24.694649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 454/946] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:24.705656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:24.713786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:24.798233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab944ca-e316-49f0-9429-2b70f9d6ac37 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:24.839360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfd302-7dbd-48f7-9221-e486f302e245 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:24.843929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:24.844882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:24.845476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:24.846011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:24.846914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:24.847535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:24.849271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:24.862078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 493/947] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:24.863854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:24.885402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e85b514-3c2c-4533-94aa-a2f0a8365c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:24.886095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b514-3c2c-4533-94aa-a2f0a8365c36 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:24.886376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b514-3c2c-4533-94aa-a2f0a8365c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:24.886651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e85b514-3c2c-4533-94aa-a2f0a8365c36 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:24.887344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85b514-3c2c-4533-94aa-a2f0a8365c36 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:24.887648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85b514-3c2c-4533-94aa-a2f0a8365c36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:24.889162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e85b514-3c2c-4533-94aa-a2f0a8365c36 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:24.893625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:24.921936 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 455/948] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:25.007901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1903-1cc0-4478-8980-cdd57340311f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:25.052899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14db85-6ffc-41a6-ad61-7fd0624fffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:25.053947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14db85-6ffc-41a6-ad61-7fd0624fffea None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:25.054456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14db85-6ffc-41a6-ad61-7fd0624fffea None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:25.054960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14db85-6ffc-41a6-ad61-7fd0624fffea None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:25.055938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14db85-6ffc-41a6-ad61-7fd0624fffea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:25.057738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14db85-6ffc-41a6-ad61-7fd0624fffea None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:25.089769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 494/949] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:36:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:36:26.110048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa949a-94aa-428d-aae8-dde90a13e8b2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:26.110647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa949a-94aa-428d-aae8-dde90a13e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:26.110647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa949a-94aa-428d-aae8-dde90a13e8b2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:26.112291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 456/950] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:26.117937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d28cc-b277-4dd3-a9ec-20fc6bd31f3f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:26.118417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d28cc-b277-4dd3-a9ec-20fc6bd31f3f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:26.118491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d28cc-b277-4dd3-a9ec-20fc6bd31f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:26.138299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bf4d28cc-b277-4dd3-a9ec-20fc6bd31f3f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:26.139502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bf4d28cc-b277-4dd3-a9ec-20fc6bd31f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:26.244677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:26.259378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 495/951] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:26.732996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa949a-94aa-428d-aae8-dde90a13e8b2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:26.749114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fac6e-768a-4e92-a2c7-57e66c30c812 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:26.749454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fac6e-768a-4e92-a2c7-57e66c30c812 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:26.749699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fac6e-768a-4e92-a2c7-57e66c30c812 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:26.751289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 496/952] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:26.758991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aedfa8-823b-477d-8d3b-42b61e135bc2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:26.759712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aedfa8-823b-477d-8d3b-42b61e135bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:26.760358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aedfa8-823b-477d-8d3b-42b61e135bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:26.784140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b3aedfa8-823b-477d-8d3b-42b61e135bc2 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:26.786739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b3aedfa8-823b-477d-8d3b-42b61e135bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:26.834784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:26.893766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 497/953] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:26.900642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa949a-94aa-428d-aae8-dde90a13e8b2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:26.965507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:26.967033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:26.967799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:26.968508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:26.969780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:26.972569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:26.989970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:26.991988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:26.993840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:26.998859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 457/954] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:27.006316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aedfa8-823b-477d-8d3b-42b61e135bc2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:27.122172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aedfa8-823b-477d-8d3b-42b61e135bc2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:27.153918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:27.162865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:27.163498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.163777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.164013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.164677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:27.164982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:27.166413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:27.176820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 498/955] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:27.179050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:27.309121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:27.403282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e17e5-8970-4da2-a880-f4c72fce91f2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:27.494438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:27.496033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.496955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.497779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.499275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:27.500165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:27.503909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:27.507306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:27.521138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb6fad-1732-44df-8de7-63da993ddacd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:27.524757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 458/956] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:27.530511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:27.584484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8d4b4-9162-4409-8b33-29de6f17fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:27.585536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d4b4-9162-4409-8b33-29de6f17fad6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.586112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d4b4-9162-4409-8b33-29de6f17fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.586778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d4b4-9162-4409-8b33-29de6f17fad6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.606985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8d4b4-9162-4409-8b33-29de6f17fad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-bbb8d4b4-9162-4409-8b33-29de6f17fad6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:27.617590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:27.619049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:27.620209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:27.629640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 499/957] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 4 12:36:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:27.634591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8d4b4-9162-4409-8b33-29de6f17fad6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:27.712444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdaa6b-bc4f-41e9-b288-9d51cfdefa7e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:27.750091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:27.778612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7d7c-85a8-4dbc-8428-c8bc74916d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:27.779687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7d7c-85a8-4dbc-8428-c8bc74916d52 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.780183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7d7c-85a8-4dbc-8428-c8bc74916d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.780668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7d7c-85a8-4dbc-8428-c8bc74916d52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.781638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f7d7c-85a8-4dbc-8428-c8bc74916d52 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:27.785076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f7d7c-85a8-4dbc-8428-c8bc74916d52 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:27.786619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8d4b4-9162-4409-8b33-29de6f17fad6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:27.818641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 459/958] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:36:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:36:27.820111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8c4c7-7118-4855-b8da-f12477e5ef34 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.820391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8c4c7-7118-4855-b8da-f12477e5ef34 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.820671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8c4c7-7118-4855-b8da-f12477e5ef34 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.822830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 460/959] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:27.828904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700865-c37e-4363-abaf-adf3c3c4ba81 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.829353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700865-c37e-4363-abaf-adf3c3c4ba81 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.829644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700865-c37e-4363-abaf-adf3c3c4ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.854627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3a700865-c37e-4363-abaf-adf3c3c4ba81 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:27.856304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3a700865-c37e-4363-abaf-adf3c3c4ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:27.881421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd025b-5ac5-4b93-b13f-ed003af9636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:27.883433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd025b-5ac5-4b93-b13f-ed003af9636f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.883990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd025b-5ac5-4b93-b13f-ed003af9636f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.884596 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd025b-5ac5-4b93-b13f-ed003af9636f None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.885810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd025b-5ac5-4b93-b13f-ed003af9636f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:27.886339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd025b-5ac5-4b93-b13f-ed003af9636f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:27.889144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd025b-5ac5-4b93-b13f-ed003af9636f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:27.913948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 500/960] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 4 12:36:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:27.913948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeec8f-197b-4566-a701-ddb60d20aa98 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.913948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeec8f-197b-4566-a701-ddb60d20aa98 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.913948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeec8f-197b-4566-a701-ddb60d20aa98 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.913948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 501/961] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:27.922609 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeec8f-197b-4566-a701-ddb60d20aa98 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:27.927541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:27.956662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 461/962] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:27.959297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d08db-9ba5-4b6e-8783-91ed05ee7091 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:27.959925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d08db-9ba5-4b6e-8783-91ed05ee7091 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:27.960230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d08db-9ba5-4b6e-8783-91ed05ee7091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:27.994155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3c2d08db-9ba5-4b6e-8783-91ed05ee7091 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:27.996290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3c2d08db-9ba5-4b6e-8783-91ed05ee7091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:28.110091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 462/963] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:28.110461 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeec8f-197b-4566-a701-ddb60d20aa98 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:28.124400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:28.153243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:28.154146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:28.154566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:28.155126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:28.169278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:28.171040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:28.187288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:28.189130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:28.190880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:28.190880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:28.190880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:28.190880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 502/964] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:28.201459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d08db-9ba5-4b6e-8783-91ed05ee7091 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:28.396142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d08db-9ba5-4b6e-8783-91ed05ee7091 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:28.397701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:28.443245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:28.480452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:28.481134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:28.481427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:28.481786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:28.482399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:28.482705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:28.484139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:28.501707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 463/965] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:28.501707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:28.586778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14380e7f-7c71-4401-8828-4971e4ee5595 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:28.634355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:28.635262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:28.635730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:28.636146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:28.636953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:28.638999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:28.643059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING keystone.server.flask.common [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 12:36:28.656175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e886-a00f-4f72-9fb8-2c363bbcf2e4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:28.666975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.sql.core [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 12:36:28.666975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 12:36:28.666975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [parameters: {'user_id': '1eff4968030a4a13b7767158320b9a9b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 12:36:28.666975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88339) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application conn.query(q) Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result.read() Oct 04 12:36:28.681677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 12:36:28.683468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application next(self.gen) Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application yield resource Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application next(self.gen) Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise self.value Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application session.commit() Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 12:36:28.685926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.session.flush() Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application compat.raise_( Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 12:36:28.687945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 12:36:28.691321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application conn.query(q) Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application result.read() Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 12:36:28.694830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [parameters: {'user_id': '1eff4968030a4a13b7767158320b9a9b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:28.697702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 12:36:28.699711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 12:36:28.702110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 12:36:28.702110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 12:36:28.702110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 12:36:28.702110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 12:36:28.702110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 12:36:28.702110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:28.702110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 503/966] 10.222.0.30 () {60 vars in 1131 bytes} [Tue Oct 4 12:36:28 2022] POST /identity/v3/users => generated 160 bytes in 287 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:28.702110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:28.730547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:28.731493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:28.731775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:28.732048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:28.732780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:28.734921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:28.748219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:28.750845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:28.758221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:28.760444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 464/967] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:28.762178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:28.818522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:28.885538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a428-9963-4f77-a55c-3f84b1fcdfe1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:28.915362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05f399-8d62-4fb2-b25f-5ea38268f4f4 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:28.950842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:28.951479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:28.951761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:28.952040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:28.961220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:28.962928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:28.964941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:28.967896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:28.968408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:28.968905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:28.976079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:28.978367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 12:36:28.980262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:28.982205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 504/968] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:36:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:28.983161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:28.983632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:28.986761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:29.010845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:29.012594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 465/969] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:36:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:29.015523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:29.118933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:29.139371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b4673-8a16-4e07-895a-a14ff18c09a9 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:29.182186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:29.189653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f042008-f679-4b44-8297-0f0a1ab2093b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:29.198377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:29.199469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:29.200171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:29.200487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:29.201226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:29.201668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:29.203884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:29.215648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 505/970] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:29.217080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:29.244506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:29.245966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:29.246413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:29.246690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:29.247444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:29.247750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:29.249220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:29.276103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 466/971] 10.222.0.30 () {56 vars in 1149 bytes} [Tue Oct 4 12:36:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:29.276103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:29.374912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6066-b04f-470b-81fe-0b552affecf2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:29.437210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:29.438093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:29.438223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d85dae-ecd5-48be-8310-9b41ae36d3ea None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:29.438538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:29.439004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:29.440261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:29.440879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:29.443111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:29.496846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:29.497839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:29.498350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:29.498800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:29.499847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:29.500345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:29.503492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:29.508444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 506/972] 10.222.0.30 () {56 vars in 1101 bytes} [Tue Oct 4 12:36:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:29.511487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:29.511641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 467/973] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:29.525373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:29.701588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc57cd-b530-4927-b9ce-af46c834d6d6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:29.776791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bf455-5960-48dd-8814-34ef215d96c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:29.783845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bf455-5960-48dd-8814-34ef215d96c3 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:29.783845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bf455-5960-48dd-8814-34ef215d96c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:29.783845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bf455-5960-48dd-8814-34ef215d96c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:29.890602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bf455-5960-48dd-8814-34ef215d96c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:29.893275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bf455-5960-48dd-8814-34ef215d96c3 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:29.907884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:30.053722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 507/974] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:36:30.056812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:30.082673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:30.201763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bbf61-385f-47ff-96bb-bfa74954ec0f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:30.261396 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:30.262585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:30.262992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:30.263450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:30.284704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:30.287490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:30.309205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:30.310604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:30.311907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:30.311907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:30.311907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:30.318878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 468/975] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:30.320865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bf455-5960-48dd-8814-34ef215d96c3 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:30.469538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bf455-5960-48dd-8814-34ef215d96c3 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:30.478973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:30.517646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b643a30-1e22-4aa1-9d24-59cb86c8cabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:30.518388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b643a30-1e22-4aa1-9d24-59cb86c8cabd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:30.518742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b643a30-1e22-4aa1-9d24-59cb86c8cabd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:30.519086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b643a30-1e22-4aa1-9d24-59cb86c8cabd None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:30.519863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b643a30-1e22-4aa1-9d24-59cb86c8cabd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:30.520242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b643a30-1e22-4aa1-9d24-59cb86c8cabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:30.521844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b643a30-1e22-4aa1-9d24-59cb86c8cabd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:30.537906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 508/976] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:30.543744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:30.643628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:30.682260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0737d-cb7a-4156-83c6-38c40ed0c0e7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:30.722026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:30.722837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:30.723185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:30.723561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:30.731495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:30.733066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:30.736136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b9587-8ca4-4b25-b982-313c3d823c1a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:30.736636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b9587-8ca4-4b25-b982-313c3d823c1a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:30.737118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b9587-8ca4-4b25-b982-313c3d823c1a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:30.739865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 509/977] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:30.746668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:30.748671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:30.750580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:30.750580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:30.750580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:30.750580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:30.750580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:30.750580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:30.750580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:30.750580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:30.751486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd28f-0021-4c50-8313-117cd6783ca3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:30.751486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd28f-0021-4c50-8313-117cd6783ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:30.751486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bd28f-0021-4c50-8313-117cd6783ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:30.753476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 469/978] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:30.754190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:30.782043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-af0bd28f-0021-4c50-8313-117cd6783ca3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:30.785106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-af0bd28f-0021-4c50-8313-117cd6783ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:30.890509 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 510/979] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:30.896705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bd112-9868-4744-9161-8099d29db39b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:30.957047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:30.966344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:30.967584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:30.968107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:30.968762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:30.970532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:30.971224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:30.974085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:31.002382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 470/980] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:31.004282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bd28f-0021-4c50-8313-117cd6783ca3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:31.129212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:31.137236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bd28f-0021-4c50-8313-117cd6783ca3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:31.178209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:31.178943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:31.179355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:31.179770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:31.180651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] RBAC: Adding query filter params (role.id=afda32e5fe2649aa9e427ff8657c62e0, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=da6017ad9ed5432f91dcb909b72f9a84) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:31.181108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:31.182794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:31.190093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 511/981] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:31 2022] GET /identity/v3/role_assignments?user.id=da6017ad9ed5432f91dcb909b72f9a84&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=afda32e5fe2649aa9e427ff8657c62e0 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:31.207871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:31.375608 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01480c-f512-456f-a0d5-389c3e49b15a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:31.442784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:31.443777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:31.444259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:31.444725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:31.445861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:31.448356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:31.465784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:31.466818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:31.467626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:31.468348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 471/982] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:31.478226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:31.602316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ee43-a780-4321-abca-6a5a1e068414 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:31.640351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:31.641136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:31.641537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:31.642568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:31.643335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:31.643759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:31.645262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:31.656550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 512/983] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:31.657922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:31.725766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:31.778121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581f4b-4ea1-4622-95b5-396a9c24d00b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:31.818285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3af19a-a060-446f-986d-e491b6c51ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:31.818901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af19a-a060-446f-986d-e491b6c51ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:31.819183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af19a-a060-446f-986d-e491b6c51ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:31.819432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3af19a-a060-446f-986d-e491b6c51ad2 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:31.820064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3af19a-a060-446f-986d-e491b6c51ad2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:31.820380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3af19a-a060-446f-986d-e491b6c51ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:31.821754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3af19a-a060-446f-986d-e491b6c51ad2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:31.827632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 472/984] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:31.834255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:31.885075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:32.039108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bb2a5-8a7b-4c89-a663-ee09f4b61564 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:32.077585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13245b92-b22d-4754-b57d-8d56accfd03d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:32.077925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13245b92-b22d-4754-b57d-8d56accfd03d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:32.078183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13245b92-b22d-4754-b57d-8d56accfd03d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:32.079819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 473/985] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:32.085378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c381a-f512-4339-860f-79cb40695edc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:32.085806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c381a-f512-4339-860f-79cb40695edc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:32.085951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c381a-f512-4339-860f-79cb40695edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:32.105190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:32.106327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:32.106509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-333c381a-f512-4339-860f-79cb40695edc None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:32.106833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:32.107313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:32.107612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-333c381a-f512-4339-860f-79cb40695edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:32.108642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] RBAC: Adding query filter params (interface=admin, service_id=424b172c42fa40e69dc6062e4a863c96, region_id=RegionOne) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:32.109198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:32.114071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:32.124536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 513/986] 10.222.0.30 () {56 vars in 1249 bytes} [Tue Oct 4 12:36:31 2022] GET /identity/v3/endpoints?service_id=424b172c42fa40e69dc6062e4a863c96&interface=admin®ion_id=RegionOne => generated 193 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:32.135257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:32.212245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 474/987] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:32.311885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:32.335902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d831-2110-44f3-99d7-b4d769ab0ef5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:32.399084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095d308-3f47-4677-b914-f8b0c8670028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:32.400152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095d308-3f47-4677-b914-f8b0c8670028 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:32.400651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095d308-3f47-4677-b914-f8b0c8670028 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:32.401150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095d308-3f47-4677-b914-f8b0c8670028 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:32.402564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095d308-3f47-4677-b914-f8b0c8670028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:32.405172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095d308-3f47-4677-b914-f8b0c8670028 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:32.422086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 514/988] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:36:32 2022] GET /identity/v3/services => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:36:32.488677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c381a-f512-4339-860f-79cb40695edc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:32.548341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:32.620228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c381a-f512-4339-860f-79cb40695edc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:32.678296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10da242-354c-444e-9885-9d61cdc9d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:32.679009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10da242-354c-444e-9885-9d61cdc9d80e None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:32.679295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10da242-354c-444e-9885-9d61cdc9d80e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:32.679573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10da242-354c-444e-9885-9d61cdc9d80e None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:32.680249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10da242-354c-444e-9885-9d61cdc9d80e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:32.681690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10da242-354c-444e-9885-9d61cdc9d80e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:32.704285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 475/989] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:36:32 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:33.792388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fb93-e7a7-432f-9f89-7f9e3aa8e8c4 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:33.793176 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fb93-e7a7-432f-9f89-7f9e3aa8e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:33.793176 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fb93-e7a7-432f-9f89-7f9e3aa8e8c4 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:33.794305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 515/990] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:33.801875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20947d6-cf12-4138-ba93-86f1817bdcac None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:33.802401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20947d6-cf12-4138-ba93-86f1817bdcac None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:33.802872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20947d6-cf12-4138-ba93-86f1817bdcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:33.834274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f20947d6-cf12-4138-ba93-86f1817bdcac None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:33.835733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f20947d6-cf12-4138-ba93-86f1817bdcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:33.949640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 476/991] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:34.442385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915fb93-e7a7-432f-9f89-7f9e3aa8e8c4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:34.635327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915fb93-e7a7-432f-9f89-7f9e3aa8e8c4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:34.698810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd3df1-2c78-4dcb-9872-fe94fe5d8d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:34.700305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd3df1-2c78-4dcb-9872-fe94fe5d8d2c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:34.701062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd3df1-2c78-4dcb-9872-fe94fe5d8d2c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:34.701901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd3df1-2c78-4dcb-9872-fe94fe5d8d2c None admin] PATH_INFO: `/v3/services/image` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:34.703230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd3df1-2c78-4dcb-9872-fe94fe5d8d2c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:34.706723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd3df1-2c78-4dcb-9872-fe94fe5d8d2c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-61cd3df1-2c78-4dcb-9872-fe94fe5d8d2c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:34.724328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:34.726308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:34.727967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:34.733632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 516/992] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Oct 4 12:36:34 2022] GET /identity/v3/services/image => generated 86 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:34.738311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20947d6-cf12-4138-ba93-86f1817bdcac None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:34.807363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:34.950211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20947d6-cf12-4138-ba93-86f1817bdcac None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:34.993625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ad7b-d991-417e-818b-b42758ec6003 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:34.994515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ad7b-d991-417e-818b-b42758ec6003 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:34.994985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ad7b-d991-417e-818b-b42758ec6003 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:34.997864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 517/993] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:35.005468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae884-e11a-4fa0-83fa-2d6f2f5217c0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:35.006141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae884-e11a-4fa0-83fa-2d6f2f5217c0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:35.006722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ae884-e11a-4fa0-83fa-2d6f2f5217c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:35.019973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:35.021038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:35.021505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:35.022062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:35.023244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] RBAC: Adding query filter params (name=image) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:35.023800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:35.026492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:35.036371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 477/994] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:35.040046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-749ae884-e11a-4fa0-83fa-2d6f2f5217c0 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:35.041339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-749ae884-e11a-4fa0-83fa-2d6f2f5217c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:35.046012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:35.060503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:35.150901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 518/995] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:35.204055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:35.210804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb4f5a-5de3-4f97-8ec6-ed43744a45fe None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:35.229470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6812d-beaf-4303-9a8e-744d2510e17c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:35.230014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6812d-beaf-4303-9a8e-744d2510e17c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:35.231052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6812d-beaf-4303-9a8e-744d2510e17c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:35.234268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 519/996] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:36:35.243279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8d83-72a6-4a1e-adf2-7ebe7b8a79db None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:35.243773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8d83-72a6-4a1e-adf2-7ebe7b8a79db None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:35.244259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8d83-72a6-4a1e-adf2-7ebe7b8a79db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:35.270451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-849c8d83-72a6-4a1e-adf2-7ebe7b8a79db None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:35.271932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-849c8d83-72a6-4a1e-adf2-7ebe7b8a79db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:35.272232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:35.273265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:35.273803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:35.274289 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:35.275423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] RBAC: Adding query filter params (type=image) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:35.275949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:35.278806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:35.297641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 478/997] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:35.385899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 520/998] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:35.424257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:35.545839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c6942-7c53-4c15-9526-1fe36cc2d21d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:35.604165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:35.604810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:35.605078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:35.605344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:35.605975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:35.607365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:35.617504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:35.619730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:35.621454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 479/999] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:35.626004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c8d83-72a6-4a1e-adf2-7ebe7b8a79db None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:35.749314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:35.790911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c8d83-72a6-4a1e-adf2-7ebe7b8a79db None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:35.855756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:35.856832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:35.857333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:35.857873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:35.859043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:35.859589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:35.863397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:35.864658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:35.871175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 521/1000] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:35.877290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:35.913177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:36.004707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac52a39-a089-4fe3-bbd7-18cd15f36443 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:36.054702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbabf8-d716-47f4-819a-e8c4ec14b10f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:36.056891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:36.058011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:36.058507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:36.059079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:36.060157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:36.062709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:36.081198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:36.082426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 12:36:36.083245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:36.086421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 480/1001] 10.222.0.30 () {56 vars in 1126 bytes} [Tue Oct 4 12:36:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:36.091705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:36.115056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:36.116598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:36.117105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:36.117571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:36.118689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:36.119224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:36.122808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:36.141631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 522/1002] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:36.144120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:36.152307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:36.229973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:36.242348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b905bd-d17d-4d3b-9131-4f367862a71b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:36.288196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:36.289257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:36.289805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:36.290297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:36.291500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:36.292059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:36.294721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:36.310129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 481/1003] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:36.314924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:36.318371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290387-c3d4-4b6a-a105-c390f54d7cc5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:36.361995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:36.363025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:36.363505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:36.363962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:36.364885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] RBAC: Adding query filter params (interface=public, service_id=d3fe0f5ec0404753a3158d1ab3804956, region_id=RegionOne) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:36.365472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:36.367290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:36.374473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 523/1004] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 4 12:36:36 2022] GET /identity/v3/endpoints?service_id=d3fe0f5ec0404753a3158d1ab3804956&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:36.384169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:36.492977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e08cc5-98f6-425b-9e1b-799b3abf1faf None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:36.494373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:36.544911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a014c2a-0281-48c9-b3ae-1a7f595f8c40 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:36.554207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:36.555283 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:36.555771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:36.556238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:36.557363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:36.557908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:36.560477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:36.574975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 482/1005] 10.222.0.30 () {56 vars in 1122 bytes} [Tue Oct 4 12:36:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:36.576779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:36.609371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccb826-0c43-4bc9-af41-63a1cdb34395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:36.610975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb826-0c43-4bc9-af41-63a1cdb34395 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:36.611470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb826-0c43-4bc9-af41-63a1cdb34395 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:36.611932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccb826-0c43-4bc9-af41-63a1cdb34395 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:36.613030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccb826-0c43-4bc9-af41-63a1cdb34395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:36.615244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccb826-0c43-4bc9-af41-63a1cdb34395 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:36.615956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:36.628484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 524/1006] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:36:36 2022] GET /identity/v3/services => generated 1727 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:36:36.720802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2753f-6e0a-486c-b355-af85d2dbf02e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:36.761936 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921690e-2cd7-47dd-9f00-3ca033e24060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:36.762550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921690e-2cd7-47dd-9f00-3ca033e24060 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:36.762825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921690e-2cd7-47dd-9f00-3ca033e24060 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:36.763093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921690e-2cd7-47dd-9f00-3ca033e24060 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:36.763798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921690e-2cd7-47dd-9f00-3ca033e24060 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:36.765221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921690e-2cd7-47dd-9f00-3ca033e24060 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:36.785222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 483/1007] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:36:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:36:38.097336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff192-d28b-4d88-a26e-b8b8f106ad25 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:38.097903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff192-d28b-4d88-a26e-b8b8f106ad25 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:38.097903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ff192-d28b-4d88-a26e-b8b8f106ad25 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:38.099360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 525/1008] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:38.105150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7ed34-acc8-4d93-98cc-ae5afa20a8b7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:38.105670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7ed34-acc8-4d93-98cc-ae5afa20a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:38.105751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7ed34-acc8-4d93-98cc-ae5afa20a8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:38.124682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-63c7ed34-acc8-4d93-98cc-ae5afa20a8b7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:38.126444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-63c7ed34-acc8-4d93-98cc-ae5afa20a8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:38.206948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 484/1009] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:38.476463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ff192-d28b-4d88-a26e-b8b8f106ad25 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:38.629242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ff192-d28b-4d88-a26e-b8b8f106ad25 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:38.684984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:38.695743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6542a5-d3cf-470b-9b75-ede3970a6eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:38.696376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6542a5-d3cf-470b-9b75-ede3970a6eca None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:38.696831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6542a5-d3cf-470b-9b75-ede3970a6eca None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:38.697127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6542a5-d3cf-470b-9b75-ede3970a6eca None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:38.698062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6542a5-d3cf-470b-9b75-ede3970a6eca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:38.699483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6542a5-d3cf-470b-9b75-ede3970a6eca None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:38.729691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 526/1010] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:36:38 2022] POST /identity/v3/services => generated 242 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:39.238714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af560-0711-4a7d-8784-37247356ace0 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:39.239498 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af560-0711-4a7d-8784-37247356ace0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:39.239498 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8af560-0711-4a7d-8784-37247356ace0 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:39.240940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 485/1011] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:39.246226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7e4c1-dc8e-44ac-8f1c-49d00c86fe5f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:39.246606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7e4c1-dc8e-44ac-8f1c-49d00c86fe5f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:39.246768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7e4c1-dc8e-44ac-8f1c-49d00c86fe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:39.246905 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2693-32a0-428b-8043-548d64ba4a1a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:39.247610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2693-32a0-428b-8043-548d64ba4a1a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:39.247610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2693-32a0-428b-8043-548d64ba4a1a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:39.249060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 527/1012] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:39.255186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fbd2-01be-4f69-a762-a14c7f3ba7ae None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:39.255468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fbd2-01be-4f69-a762-a14c7f3ba7ae None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:39.255743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fbd2-01be-4f69-a762-a14c7f3ba7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:39.261967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:39.271970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c3d7e4c1-dc8e-44ac-8f1c-49d00c86fe5f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:39.273274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c3d7e4c1-dc8e-44ac-8f1c-49d00c86fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:39.277710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4ae7fbd2-01be-4f69-a762-a14c7f3ba7ae None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:39.278937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4ae7fbd2-01be-4f69-a762-a14c7f3ba7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:39.361997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 486/1013] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:39.366344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 528/1014] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:39.643006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7e4c1-dc8e-44ac-8f1c-49d00c86fe5f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:39.758945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7e4c1-dc8e-44ac-8f1c-49d00c86fe5f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:39.794815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:39.803759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096540f-6b54-438a-91ec-9c325015011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:39.804432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096540f-6b54-438a-91ec-9c325015011c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:39.804710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096540f-6b54-438a-91ec-9c325015011c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:39.804987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096540f-6b54-438a-91ec-9c325015011c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:39.806343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096540f-6b54-438a-91ec-9c325015011c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:39.807884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096540f-6b54-438a-91ec-9c325015011c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:39.809710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 487/1015] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:39.811415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7fbd2-01be-4f69-a762-a14c7f3ba7ae None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:39.815737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096540f-6b54-438a-91ec-9c325015011c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:39.960266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7fbd2-01be-4f69-a762-a14c7f3ba7ae None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:39.976386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096540f-6b54-438a-91ec-9c325015011c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:40.004040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:40.024196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:40.025220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:40.025744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:40.026232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] PATH_INFO: `/v3/services/compute` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:40.027579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:40.030404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:40.030962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2c2ec-ed17-4020-a9be-86b5754cfb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:40.031822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2c2ec-ed17-4020-a9be-86b5754cfb4c None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:40.032861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2c2ec-ed17-4020-a9be-86b5754cfb4c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:40.033273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2c2ec-ed17-4020-a9be-86b5754cfb4c None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:40.034222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2c2ec-ed17-4020-a9be-86b5754cfb4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:40.036087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2c2ec-ed17-4020-a9be-86b5754cfb4c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:40.050867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:40.052449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:40.053586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 529/1016] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:40.060678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:40.094374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 488/1017] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:36:39 2022] POST /identity/v3/projects => generated 311 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:36:40.200086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1383b-bc0b-4379-b9a1-e8cf5cb6162c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:40.242630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:40.243501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:40.243926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:40.244362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:40.245147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] RBAC: Adding query filter params (name=compute) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:40.245648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:40.247212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:40.258527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 530/1018] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:40.260962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2c2ec-ed17-4020-a9be-86b5754cfb4c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:40.353613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:40.433702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2c2ec-ed17-4020-a9be-86b5754cfb4c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:40.474043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec88b3-0568-4ab2-8c18-afa043c1d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:40.474673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec88b3-0568-4ab2-8c18-afa043c1d7ab None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:40.474948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec88b3-0568-4ab2-8c18-afa043c1d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:40.475222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec88b3-0568-4ab2-8c18-afa043c1d7ab None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:40.475863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec88b3-0568-4ab2-8c18-afa043c1d7ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:40.476156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec88b3-0568-4ab2-8c18-afa043c1d7ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:40.477554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec88b3-0568-4ab2-8c18-afa043c1d7ab None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:40.483827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 489/1019] 10.222.0.30 () {56 vars in 1112 bytes} [Tue Oct 4 12:36:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:40.489846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:40.585934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:40.681250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e6b5f-ae8e-4d13-9b68-b27989d4f3be None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:40.742789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935ed90-b4ee-49d8-a9d4-186dcb02a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:40.743746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ed90-b4ee-49d8-a9d4-186dcb02a0cc None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:40.744200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ed90-b4ee-49d8-a9d4-186dcb02a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:40.744639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935ed90-b4ee-49d8-a9d4-186dcb02a0cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:40.745734 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935ed90-b4ee-49d8-a9d4-186dcb02a0cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:40.747987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935ed90-b4ee-49d8-a9d4-186dcb02a0cc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:40.775747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 531/1020] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:36:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:36:41.680170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cd05-5c74-4822-8ecf-f89a7fbd4c1b None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:41.680676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cd05-5c74-4822-8ecf-f89a7fbd4c1b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:41.681047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391cd05-5c74-4822-8ecf-f89a7fbd4c1b None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:41.683836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 490/1021] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:41.690214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53f5e-e610-425c-9182-9ad6f08b7531 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:41.690996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53f5e-e610-425c-9182-9ad6f08b7531 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:41.690996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53f5e-e610-425c-9182-9ad6f08b7531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:41.710353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-85d53f5e-e610-425c-9182-9ad6f08b7531 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:41.711586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-85d53f5e-e610-425c-9182-9ad6f08b7531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:41.841658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 532/1022] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:42.108722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391cd05-5c74-4822-8ecf-f89a7fbd4c1b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:42.291114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391cd05-5c74-4822-8ecf-f89a7fbd4c1b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:42.324086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:42.349880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86002300-98ee-432e-bffc-b7e08bab573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:42.350548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002300-98ee-432e-bffc-b7e08bab573b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:42.350847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002300-98ee-432e-bffc-b7e08bab573b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:42.351107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86002300-98ee-432e-bffc-b7e08bab573b None admin] PATH_INFO: `/v3/services/image` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:42.351713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002300-98ee-432e-bffc-b7e08bab573b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:42.353336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86002300-98ee-432e-bffc-b7e08bab573b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-86002300-98ee-432e-bffc-b7e08bab573b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:42.363992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:42.365959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:42.367643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:42.370094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 491/1023] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Oct 4 12:36:42 2022] GET /identity/v3/services/image => generated 86 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:42.372509 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d53f5e-e610-425c-9182-9ad6f08b7531 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:42.430588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:42.559240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d53f5e-e610-425c-9182-9ad6f08b7531 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:42.570740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dece4-7a2d-4840-8f2d-4e88be823cfb None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:42.571058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dece4-7a2d-4840-8f2d-4e88be823cfb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:42.571302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dece4-7a2d-4840-8f2d-4e88be823cfb None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:42.573293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 492/1024] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:42.578818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8831ba-354f-4879-8aeb-80ebe5abad6a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:42.581723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8831ba-354f-4879-8aeb-80ebe5abad6a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:42.581723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8831ba-354f-4879-8aeb-80ebe5abad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:42.604503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cc8831ba-354f-4879-8aeb-80ebe5abad6a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:42.605761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cc8831ba-354f-4879-8aeb-80ebe5abad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:42.615574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:42.616090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:42.616368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:42.617064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:42.617321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] RBAC: Adding query filter params (name=image) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:42.617557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:42.618944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:42.626853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 533/1025] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:42.632546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:42.690914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 493/1026] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:42.779177 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:42.789971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049b49-0d5d-4150-93b4-5838ddbf7f95 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:42.850806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:42.851852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:42.852342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:42.852818 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:42.853969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] RBAC: Adding query filter params (type=image) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:42.854497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:42.857145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:42.871300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 534/1027] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:42.872981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8831ba-354f-4879-8aeb-80ebe5abad6a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:42.984412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8831ba-354f-4879-8aeb-80ebe5abad6a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:42.996899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:43.028516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:43.029149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:43.029436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:43.029753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:43.030467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] RBAC: Adding query filter params (interface=public, service_id=5db0f3aef64c4bdba03e8953d5114c0b, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:43.030785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:43.032235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:43.035528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:43.039032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 494/1028] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 4 12:36:42 2022] GET /identity/v3/endpoints?service_id=5db0f3aef64c4bdba03e8953d5114c0b&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:43.046660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:43.155371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2821a98-1e17-4a18-8cc2-081219279c0c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:43.163561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09269311-b993-4f97-b1c9-ec8894db44f3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:43.207123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32a69-3f06-4285-ba6b-418f05f98bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:43.207379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d26587-cbc1-4683-9816-56b092c831f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:43.207882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d26587-cbc1-4683-9816-56b092c831f1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:43.208167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d26587-cbc1-4683-9816-56b092c831f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:43.208265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32a69-3f06-4285-ba6b-418f05f98bab None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:43.208503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d26587-cbc1-4683-9816-56b092c831f1 None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:43.208742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32a69-3f06-4285-ba6b-418f05f98bab None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:43.209129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d26587-cbc1-4683-9816-56b092c831f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:43.209234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea32a69-3f06-4285-ba6b-418f05f98bab None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:43.210605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d26587-cbc1-4683-9816-56b092c831f1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:43.211377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea32a69-3f06-4285-ba6b-418f05f98bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:43.214219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea32a69-3f06-4285-ba6b-418f05f98bab None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:43.217662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 535/1029] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:43.218489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 495/1030] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:36:43 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:36:43.224284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32a69-3f06-4285-ba6b-418f05f98bab None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:43.268802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:43.363087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea32a69-3f06-4285-ba6b-418f05f98bab None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:43.419413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa33d0-d0f4-4e99-911a-66e062d24c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:43.423251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa33d0-d0f4-4e99-911a-66e062d24c34 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:43.423251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa33d0-d0f4-4e99-911a-66e062d24c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:43.423251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa33d0-d0f4-4e99-911a-66e062d24c34 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:43.423251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa33d0-d0f4-4e99-911a-66e062d24c34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:43.427307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa33d0-d0f4-4e99-911a-66e062d24c34 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:43.466876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 536/1031] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:36:43 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:44.396042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608361ea-94f8-431f-8a07-c347022d94de None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:44.396751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608361ea-94f8-431f-8a07-c347022d94de None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:44.397091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608361ea-94f8-431f-8a07-c347022d94de None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:44.399618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 496/1032] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:44.405559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2a52-86ff-4912-9e29-982904a5e43a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:44.406384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2a52-86ff-4912-9e29-982904a5e43a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:44.406384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2a52-86ff-4912-9e29-982904a5e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:44.428972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f9ce2a52-86ff-4912-9e29-982904a5e43a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:44.430204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f9ce2a52-86ff-4912-9e29-982904a5e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:44.513856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 537/1033] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:44.784449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608361ea-94f8-431f-8a07-c347022d94de None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:44.848151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:44.924241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608361ea-94f8-431f-8a07-c347022d94de None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:44.963994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e363-ec3b-4c1d-a53e-b19baa110cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:44.964714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e363-ec3b-4c1d-a53e-b19baa110cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:44.964973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e363-ec3b-4c1d-a53e-b19baa110cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:44.965227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352e363-ec3b-4c1d-a53e-b19baa110cb1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:44.977858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352e363-ec3b-4c1d-a53e-b19baa110cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b352e363-ec3b-4c1d-a53e-b19baa110cb1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:44.982687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:44.984421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:44.986157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 497/1034] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 4 12:36:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:44.990533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce2a52-86ff-4912-9e29-982904a5e43a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:45.019660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:45.175858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce2a52-86ff-4912-9e29-982904a5e43a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:45.239678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825281a-7a11-425d-a7ce-64c9318690e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:45.240532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825281a-7a11-425d-a7ce-64c9318690e0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:45.240923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825281a-7a11-425d-a7ce-64c9318690e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:45.241383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825281a-7a11-425d-a7ce-64c9318690e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:45.242436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825281a-7a11-425d-a7ce-64c9318690e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:45.242887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825281a-7a11-425d-a7ce-64c9318690e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:45.244944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825281a-7a11-425d-a7ce-64c9318690e0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:45.265653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 538/1035] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 4 12:36:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:45.269176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e363-ec3b-4c1d-a53e-b19baa110cb1 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:45.461692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e892-0660-4e41-b8e5-206c1c70d568 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:45.462505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e892-0660-4e41-b8e5-206c1c70d568 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:45.462505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5e892-0660-4e41-b8e5-206c1c70d568 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:45.463874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 539/1036] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:36:45.469268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:45.470119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466aaa3-3489-4659-b25c-38630ce0e347 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:45.470119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466aaa3-3489-4659-b25c-38630ce0e347 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:45.470119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466aaa3-3489-4659-b25c-38630ce0e347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:45.477038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352e363-ec3b-4c1d-a53e-b19baa110cb1 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:45.506663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1466aaa3-3489-4659-b25c-38630ce0e347 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:45.509124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1466aaa3-3489-4659-b25c-38630ce0e347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:45.521470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:45.522347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:45.522754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:45.523154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:45.541041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:45.543536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:45.570285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:45.572239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:45.574860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:45.574860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:45.574860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:45.574860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 498/1037] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:45.579480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:45.640999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 540/1038] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:45.757440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950a09-a0bd-4546-bce0-8bb75ca486f7 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:45.815191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8ab05-450b-4442-b44a-1cc6792d57a9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:45.815601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8ab05-450b-4442-b44a-1cc6792d57a9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:45.815754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8ab05-450b-4442-b44a-1cc6792d57a9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:45.817407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 541/1039] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:36:45.820746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:45.821828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:45.822332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:45.822810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:45.824050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:45.824296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c40c-8bc2-4f9b-95a9-2dbcda5406be None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:45.824591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:45.824695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c40c-8bc2-4f9b-95a9-2dbcda5406be None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:45.825033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760c40c-8bc2-4f9b-95a9-2dbcda5406be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:45.827248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:45.847817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:45.853699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 499/1040] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:45.857305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:45.857561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0760c40c-8bc2-4f9b-95a9-2dbcda5406be None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:45.860953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0760c40c-8bc2-4f9b-95a9-2dbcda5406be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:45.875941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:45.965337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 542/1041] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:45.966539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760c40c-8bc2-4f9b-95a9-2dbcda5406be None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:45.990632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1e3de-1eac-42cb-b325-ef46a86bf9cb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.033342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.033927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.034209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.034481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.042186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:46.043657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:46.061240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:46.062291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:36:46.063248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:46.068962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 500/1042] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:36:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:46.069983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:46.088029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760c40c-8bc2-4f9b-95a9-2dbcda5406be None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.127581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.128666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.129162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.129688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] PATH_INFO: `/v3/services/image` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.130531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:46.132246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:46.135788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:46.145671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:46.146941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:46.147756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 543/1043] 10.222.0.30 () {56 vars in 1105 bytes} [Tue Oct 4 12:36:45 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:46.154260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:46.176357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:46.217993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686f72b-6208-405d-bff2-25f2e8d6a9a0 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.258514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.259146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.259421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.259689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.260443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:46.260872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:46.262425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:46.293428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 501/1044] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:36:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:46.294588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:46.301827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469df43-fda3-4d2b-8342-7807adb51a43 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.345698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.346297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.346576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.346837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.347540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] RBAC: Adding query filter params (name=image) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:46.347847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:46.349281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:46.357640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 544/1045] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:46.363942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:46.424415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87e72-5574-4568-b12e-5b914fe148b3 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.452970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:46.459014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:46.470683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465ae5a-f2c5-4ce9-919c-9ea930048a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.471653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465ae5a-f2c5-4ce9-919c-9ea930048a36 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.472108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465ae5a-f2c5-4ce9-919c-9ea930048a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.472571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465ae5a-f2c5-4ce9-919c-9ea930048a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.515290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67f878-dc3d-4f88-b131-2080b0895b59 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.558724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.559252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.559529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.559800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.560476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] RBAC: Adding query filter params (type=image) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:46.560806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:46.562413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:46.567752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465ae5a-f2c5-4ce9-919c-9ea930048a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:46.569292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465ae5a-f2c5-4ce9-919c-9ea930048a36 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:46.570625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 545/1046] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:46.571976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:46.695628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064de0b-5500-4f8d-9faa-f39b0f24f19a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.736829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:46.749942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 502/1047] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 12:36:46.749942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465ae5a-f2c5-4ce9-919c-9ea930048a36 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:46.750356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b6d9-f3b8-46fa-b532-56d39287fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.751545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b6d9-f3b8-46fa-b532-56d39287fd32 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.751923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b6d9-f3b8-46fa-b532-56d39287fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.752273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b6d9-f3b8-46fa-b532-56d39287fd32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.771104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679b6d9-f3b8-46fa-b532-56d39287fd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e679b6d9-f3b8-46fa-b532-56d39287fd32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:46.779675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:46.780711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:46.781551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 546/1048] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:46.782904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b6d9-f3b8-46fa-b532-56d39287fd32 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:46.793569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:46.888030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465ae5a-f2c5-4ce9-919c-9ea930048a36 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.921259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b6d9-f3b8-46fa-b532-56d39287fd32 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:46.939878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00c10-6362-47c4-b0b6-63ed36f39faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.940923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00c10-6362-47c4-b0b6-63ed36f39faa None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.941418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00c10-6362-47c4-b0b6-63ed36f39faa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.941950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00c10-6362-47c4-b0b6-63ed36f39faa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.943156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c00c10-6362-47c4-b0b6-63ed36f39faa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:46.945763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c00c10-6362-47c4-b0b6-63ed36f39faa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:46.960001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:46.960719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:46.961056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:46.961491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:46.975414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:46.977030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:46.979750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 503/1049] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:36:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:36:46.981239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00c10-6362-47c4-b0b6-63ed36f39faa None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:47.001504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:47.003559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:47.005543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:47.005543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:47.005543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:47.005543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 547/1050] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:47.010142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:47.086503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:47.120988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:47.159519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00c10-6362-47c4-b0b6-63ed36f39faa None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:47.208630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:47.209646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:47.209851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce754-7d78-4548-8b07-b1d1f7d209cb None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:47.210142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:47.210536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:47.211616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:47.212021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:47.214089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:47.227892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 504/1051] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:36:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:47.237876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:47.272500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:47.273125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:47.273407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:47.273728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:47.274396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:47.274700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:47.276106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:47.290846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 548/1052] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:47.301526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:47.403229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d643c-c3a9-411e-82c1-e994c05a9140 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:47.451114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaac0c1-eb1e-4d72-b036-9ba84557de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:47.452281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaac0c1-eb1e-4d72-b036-9ba84557de85 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:47.452739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaac0c1-eb1e-4d72-b036-9ba84557de85 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:47.453180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaac0c1-eb1e-4d72-b036-9ba84557de85 None admin] PATH_INFO: `/v3/users/e12ffd463fc54ac0bfbe5fb5cd2a6d1d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:47.461203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:47.467220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e04a71-2bd9-4293-8c2a-984c7d9bbf2d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:47.470208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:47.473910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaac0c1-eb1e-4d72-b036-9ba84557de85 None admin] RBAC: Authorizing `identity:get_user(user_id=e12ffd463fc54ac0bfbe5fb5cd2a6d1d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:47.475309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaac0c1-eb1e-4d72-b036-9ba84557de85 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:47.477731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 505/1053] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:36:47 2022] GET /identity/v3/users/e12ffd463fc54ac0bfbe5fb5cd2a6d1d => generated 285 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:47.483528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaac0c1-eb1e-4d72-b036-9ba84557de85 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:47.542189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:47.543264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:47.543727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:47.544183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:47.556902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:47.559793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:47.581848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:47.582851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:47.584005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 549/1054] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:47.591735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:47.667159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaac0c1-eb1e-4d72-b036-9ba84557de85 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:47.714779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22341-5482-43bb-b6a6-35e53a99520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:47.715714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22341-5482-43bb-b6a6-35e53a99520d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:47.716194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22341-5482-43bb-b6a6-35e53a99520d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:47.716676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d22341-5482-43bb-b6a6-35e53a99520d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:47.741806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c439a-31c6-4106-be73-541aa880a273 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:47.779369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:47.780281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:47.780762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:47.781212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:47.782795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:47.783280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:47.784913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:47.801907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 550/1055] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:47.811469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:47.827349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:47.831692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d22341-5482-43bb-b6a6-35e53a99520d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:47.834992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d22341-5482-43bb-b6a6-35e53a99520d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:47.839489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:47.946917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a369d-01ad-43c5-afa2-f0d56aa67e09 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:47.965621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 506/1056] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 12:36:47.968497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22341-5482-43bb-b6a6-35e53a99520d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:47.992053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:47.993099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:47.993639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:47.994099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:47.995470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] RBAC: Adding query filter params (role.id=afda32e5fe2649aa9e427ff8657c62e0, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=175bb8ec9ccf487bb6e11f37bec82cb5) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:47.996021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:47.998677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:48.017638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 551/1057] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:47 2022] GET /identity/v3/role_assignments?user.id=175bb8ec9ccf487bb6e11f37bec82cb5&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=afda32e5fe2649aa9e427ff8657c62e0 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:48.092461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:48.097803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d22341-5482-43bb-b6a6-35e53a99520d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:48.140533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e9ea-7981-45b0-8f73-212fba928101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:48.141395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e9ea-7981-45b0-8f73-212fba928101 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:48.141881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e9ea-7981-45b0-8f73-212fba928101 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:48.142279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e9ea-7981-45b0-8f73-212fba928101 None admin] PATH_INFO: `/v3/projects/50b6f5d060524d47af764aac542a6fb7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:48.143689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e9ea-7981-45b0-8f73-212fba928101 None admin] RBAC: Authorizing `identity:get_project(project_id=50b6f5d060524d47af764aac542a6fb7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:48.145361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e9ea-7981-45b0-8f73-212fba928101 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:48.147592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 507/1058] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:36:47 2022] GET /identity/v3/projects/50b6f5d060524d47af764aac542a6fb7 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:48.154559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:48.258392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:48.283380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a42db4-6cfb-4cff-8010-a5abd5e9cce1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:48.327413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd78a3-b016-410e-85b1-7f837bcacae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:48.328157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd78a3-b016-410e-85b1-7f837bcacae1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:48.328503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd78a3-b016-410e-85b1-7f837bcacae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:48.329365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd78a3-b016-410e-85b1-7f837bcacae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:48.330208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd78a3-b016-410e-85b1-7f837bcacae1 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=50b6f5d060524d47af764aac542a6fb7, user.id=e12ffd463fc54ac0bfbe5fb5cd2a6d1d) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:48.330582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd78a3-b016-410e-85b1-7f837bcacae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:48.332164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd78a3-b016-410e-85b1-7f837bcacae1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:48.339042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 552/1059] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:48 2022] GET /identity/v3/role_assignments?user.id=e12ffd463fc54ac0bfbe5fb5cd2a6d1d&scope.project.id=50b6f5d060524d47af764aac542a6fb7&role.id=b8bf66974c0448089a192ead432a35f2 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:49.531640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793fe6-a5d5-43a0-b4e6-53314c0f6742 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:49.532912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793fe6-a5d5-43a0-b4e6-53314c0f6742 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:49.532912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793fe6-a5d5-43a0-b4e6-53314c0f6742 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:49.534477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 508/1060] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:49.539810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85df6-2870-4408-9085-c15433d9be9e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:49.540589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85df6-2870-4408-9085-c15433d9be9e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:49.540589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85df6-2870-4408-9085-c15433d9be9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:49.560799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d5c85df6-2870-4408-9085-c15433d9be9e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:49.562154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d5c85df6-2870-4408-9085-c15433d9be9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:49.678152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 553/1061] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:49.994546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793fe6-a5d5-43a0-b4e6-53314c0f6742 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:50.158495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793fe6-a5d5-43a0-b4e6-53314c0f6742 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:50.224216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4d07-66fa-4555-a15c-5e54abf3ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:50.224849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4d07-66fa-4555-a15c-5e54abf3ecba None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:50.225139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4d07-66fa-4555-a15c-5e54abf3ecba None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:50.225415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb4d07-66fa-4555-a15c-5e54abf3ecba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:50.241923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2fce0-8915-473d-83af-421e54da5e36 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:50.242535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2fce0-8915-473d-83af-421e54da5e36 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:50.243109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2fce0-8915-473d-83af-421e54da5e36 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:50.245852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 554/1062] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:50.252124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fdd82-434f-4a85-ac9d-1165771710a2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:50.252415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fdd82-434f-4a85-ac9d-1165771710a2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:50.252682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fdd82-434f-4a85-ac9d-1165771710a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:50.272966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9c8fdd82-434f-4a85-ac9d-1165771710a2 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:50.274222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9c8fdd82-434f-4a85-ac9d-1165771710a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:50.304255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:50.369104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 555/1063] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:50.376848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb4d07-66fa-4555-a15c-5e54abf3ecba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:50.379596 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb4d07-66fa-4555-a15c-5e54abf3ecba None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:50.579806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 509/1064] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 12:36:50.589027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fdd82-434f-4a85-ac9d-1165771710a2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:50.600597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:50.726615 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4d07-66fa-4555-a15c-5e54abf3ecba None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:50.758529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fdd82-434f-4a85-ac9d-1165771710a2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:50.813957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:50.814877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:50.815170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:50.815455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:50.820285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:50.831828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:50.833518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:50.853917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:50.855714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:50.857680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:50.857680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:50.857680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:50.857680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 556/1065] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:50.862991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:50.871649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb4d07-66fa-4555-a15c-5e54abf3ecba None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:50.925189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fc9de-b11c-4694-a586-8d5ca43b7243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:50.926704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc9de-b11c-4694-a586-8d5ca43b7243 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:50.927257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc9de-b11c-4694-a586-8d5ca43b7243 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:50.927747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc9de-b11c-4694-a586-8d5ca43b7243 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:50.939761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:50.942006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fc9de-b11c-4694-a586-8d5ca43b7243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-d51fc9de-b11c-4694-a586-8d5ca43b7243 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:50.947547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:50.949768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 510/1066] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 4 12:36:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:50.950641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397867-f0d2-4708-ac0d-8bf3cf73f451 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:50.951415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397867-f0d2-4708-ac0d-8bf3cf73f451 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:50.951415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397867-f0d2-4708-ac0d-8bf3cf73f451 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:50.952130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 511/1067] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:50.956754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397867-f0d2-4708-ac0d-8bf3cf73f451 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:50.995015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46277ef-748f-46bc-97a4-fe65b8e58949 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.035630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1fab7-e7d5-41fa-8f6c-4d609cd50868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.036247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1fab7-e7d5-41fa-8f6c-4d609cd50868 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.036525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1fab7-e7d5-41fa-8f6c-4d609cd50868 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.036798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1fab7-e7d5-41fa-8f6c-4d609cd50868 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.037447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1fab7-e7d5-41fa-8f6c-4d609cd50868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:51.037786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1fab7-e7d5-41fa-8f6c-4d609cd50868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:51.039154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1fab7-e7d5-41fa-8f6c-4d609cd50868 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:51.052066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 557/1068] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:51.053334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe88a-80b6-441a-aa14-7142df16a4f6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.053633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe88a-80b6-441a-aa14-7142df16a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.053915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe88a-80b6-441a-aa14-7142df16a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.074985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-23cbe88a-80b6-441a-aa14-7142df16a4f6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:51.076239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-23cbe88a-80b6-441a-aa14-7142df16a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:51.119920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397867-f0d2-4708-ac0d-8bf3cf73f451 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.162622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 558/1069] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:51.171174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:51.181197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.181853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.182135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.182407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.183088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:51.183396 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:51.184817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:51.195072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 512/1070] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 4 12:36:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:51.200845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbe88a-80b6-441a-aa14-7142df16a4f6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:51.271448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:51.344317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbe88a-80b6-441a-aa14-7142df16a4f6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.392105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.392671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.392955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.393233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.412408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:51.413562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:51.435205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:51.436716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:51.438033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:51.438033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:51.438033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:51.438033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 559/1071] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:51.446404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:51.464831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:51.556087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd236cd-7c83-494a-b3e2-14e05eb55796 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.571192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a6665-48b7-4714-b900-71c84cb294cd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.572791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:51.592897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.593717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.593863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.594054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.594722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:51.595022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:51.596397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:51.607388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade36cd-e528-403c-b19a-6d0266cd0aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.608023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade36cd-e528-403c-b19a-6d0266cd0aee None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.608308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade36cd-e528-403c-b19a-6d0266cd0aee None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.608450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 513/1072] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:51.608655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade36cd-e528-403c-b19a-6d0266cd0aee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.614554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:51.621024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade36cd-e528-403c-b19a-6d0266cd0aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-3ade36cd-e528-403c-b19a-6d0266cd0aee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:51.627169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:51.628603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:51.629492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 560/1073] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:36:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:51.634006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade36cd-e528-403c-b19a-6d0266cd0aee None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:51.668047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:51.729729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5312f4-842e-41af-a805-cb7c78374e2b None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.747825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade36cd-e528-403c-b19a-6d0266cd0aee None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.772888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.773620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.773969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.774390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.783391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.783953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:51.784072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.784273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.784547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.785217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:51.785523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:51.785667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:51.786917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:51.796397 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 561/1074] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:51.799669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:51.800668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:51.801670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 514/1075] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:36:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:51.804317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:51.806412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:51.830985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:51.929850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e172e-c610-4a3f-99a2-51cbb3cea803 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.936190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977e327-30a8-4c50-86e2-66aeebcd6a0a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:51.947291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:51.968429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e69b59-af54-461d-a6dc-2b23d3df5749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.969152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69b59-af54-461d-a6dc-2b23d3df5749 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.970029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69b59-af54-461d-a6dc-2b23d3df5749 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.970361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69b59-af54-461d-a6dc-2b23d3df5749 None admin] PATH_INFO: `/v3/users/e12ffd463fc54ac0bfbe5fb5cd2a6d1d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.971586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e69b59-af54-461d-a6dc-2b23d3df5749 None admin] RBAC: Authorizing `identity:get_user(user_id=e12ffd463fc54ac0bfbe5fb5cd2a6d1d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:51.973056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:51.973194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e69b59-af54-461d-a6dc-2b23d3df5749 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:51.973698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:51.973983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:51.974257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:51.974991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:51.975095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 562/1076] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:36:51 2022] GET /identity/v3/users/e12ffd463fc54ac0bfbe5fb5cd2a6d1d => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:51.975300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:51.976746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:51.981351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e69b59-af54-461d-a6dc-2b23d3df5749 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:51.995512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 515/1077] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:36:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:52.002023 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:52.085575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:52.096382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e69b59-af54-461d-a6dc-2b23d3df5749 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:52.127571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7dd8b0-a84c-43e2-a38f-bdfb885273fb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:52.140831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d3e1c-a28e-4178-9cf7-ec64c0822b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:52.142395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3e1c-a28e-4178-9cf7-ec64c0822b7c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:52.142848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3e1c-a28e-4178-9cf7-ec64c0822b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:52.143302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d3e1c-a28e-4178-9cf7-ec64c0822b7c None admin] PATH_INFO: `/v3/projects/50b6f5d060524d47af764aac542a6fb7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:52.144962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d3e1c-a28e-4178-9cf7-ec64c0822b7c None admin] RBAC: Authorizing `identity:get_project(project_id=50b6f5d060524d47af764aac542a6fb7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:52.147480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d3e1c-a28e-4178-9cf7-ec64c0822b7c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:52.150362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 563/1078] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:36:51 2022] GET /identity/v3/projects/50b6f5d060524d47af764aac542a6fb7 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:52.156867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d3e1c-a28e-4178-9cf7-ec64c0822b7c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:52.171873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:52.172593 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:52.172864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:52.173135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:52.184964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:52.186368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:52.202070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:52.204466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:52.206147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:52.206147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:52.206147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:52.206147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 516/1079] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:52.209570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:52.234427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:52.277585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d3e1c-a28e-4178-9cf7-ec64c0822b7c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:52.313253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08034f98-5f1b-4b05-b475-770c17fab60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:52.314165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08034f98-5f1b-4b05-b475-770c17fab60c None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:52.314514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08034f98-5f1b-4b05-b475-770c17fab60c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:52.314866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08034f98-5f1b-4b05-b475-770c17fab60c None admin] PATH_INFO: `/v3/projects/50b6f5d060524d47af764aac542a6fb7/users/e12ffd463fc54ac0bfbe5fb5cd2a6d1d/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:52.317171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08034f98-5f1b-4b05-b475-770c17fab60c None admin] RBAC: Authorizing `identity:create_grant(project_id=50b6f5d060524d47af764aac542a6fb7, user_id=e12ffd463fc54ac0bfbe5fb5cd2a6d1d, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:52.318953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08034f98-5f1b-4b05-b475-770c17fab60c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:52.324496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c2bd1-9c2a-4f09-a4f6-67f89f44acc9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:52.333655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 564/1080] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:36:52 2022] PUT /identity/v3/projects/50b6f5d060524d47af764aac542a6fb7/users/e12ffd463fc54ac0bfbe5fb5cd2a6d1d/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:36:52.368634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:52.369265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:52.369539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:52.369849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:52.370513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:52.370819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:52.372255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:52.387197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 517/1081] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:52.394583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08034f98-5f1b-4b05-b475-770c17fab60c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:52.424797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:52.527525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08034f98-5f1b-4b05-b475-770c17fab60c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:52.565686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:52.566330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:52.566607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:52.566882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:52.574114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:52.575565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:52.587431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:52.589021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:52.590039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 565/1082] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:52.594668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:52.683451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:52.704498 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306798ad-b6de-4829-aaaf-250cd82eee1c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:52.739353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4983d-f734-4dfe-b918-ad5908a61150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:52.739967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4983d-f734-4dfe-b918-ad5908a61150 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:52.740249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4983d-f734-4dfe-b918-ad5908a61150 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:52.740527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4983d-f734-4dfe-b918-ad5908a61150 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:52.741217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4983d-f734-4dfe-b918-ad5908a61150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:52.741527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4983d-f734-4dfe-b918-ad5908a61150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:52.742988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4983d-f734-4dfe-b918-ad5908a61150 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:52.755650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 518/1083] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:52.761783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:52.868140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:52.901014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8c1dc-4fb0-4870-b9da-3111c7a6a706 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:52.957250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65821b-40bd-497e-ab30-2e7eb6b54fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:52.958414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65821b-40bd-497e-ab30-2e7eb6b54fcb None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:52.958927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65821b-40bd-497e-ab30-2e7eb6b54fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:52.959426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65821b-40bd-497e-ab30-2e7eb6b54fcb None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/175bb8ec9ccf487bb6e11f37bec82cb5/roles/afda32e5fe2649aa9e427ff8657c62e0` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:52.962869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65821b-40bd-497e-ab30-2e7eb6b54fcb None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=175bb8ec9ccf487bb6e11f37bec82cb5, role_id=afda32e5fe2649aa9e427ff8657c62e0)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:52.965653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65821b-40bd-497e-ab30-2e7eb6b54fcb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:52.983078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 566/1084] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:36:52 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/175bb8ec9ccf487bb6e11f37bec82cb5/roles/afda32e5fe2649aa9e427ff8657c62e0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:36:54.543798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a6de8-9f1e-458f-be24-abdcba9a800f None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:54.544362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a6de8-9f1e-458f-be24-abdcba9a800f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:54.544362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a6de8-9f1e-458f-be24-abdcba9a800f None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:54.545959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 519/1085] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:54.552999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fce19-02ec-4231-8dda-045335cfce44 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:54.553742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fce19-02ec-4231-8dda-045335cfce44 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:54.553930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fce19-02ec-4231-8dda-045335cfce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:54.573250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a22fce19-02ec-4231-8dda-045335cfce44 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:54.574486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a22fce19-02ec-4231-8dda-045335cfce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:54.657615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 567/1086] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:54.936006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a6de8-9f1e-458f-be24-abdcba9a800f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:55.042213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a6de8-9f1e-458f-be24-abdcba9a800f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:55.077511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713832c-3dcf-4598-8d24-31d29c9dd856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:55.078157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713832c-3dcf-4598-8d24-31d29c9dd856 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.078432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713832c-3dcf-4598-8d24-31d29c9dd856 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.079208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713832c-3dcf-4598-8d24-31d29c9dd856 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.087017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:55.090670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713832c-3dcf-4598-8d24-31d29c9dd856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c713832c-3dcf-4598-8d24-31d29c9dd856 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:55.096553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:55.098225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:36:55.099094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:55.101814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 520/1087] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:36:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:55.103974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fce19-02ec-4231-8dda-045335cfce44 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:55.184257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:55.217838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fce19-02ec-4231-8dda-045335cfce44 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:55.236935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3627d-a340-404d-8c76-64c325a6f814 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.237471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3627d-a340-404d-8c76-64c325a6f814 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.237945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3627d-a340-404d-8c76-64c325a6f814 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.239464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 521/1088] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:36:55.245796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc34d2-18c6-46b9-b524-d48b21650684 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.246232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc34d2-18c6-46b9-b524-d48b21650684 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.246656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc34d2-18c6-46b9-b524-d48b21650684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.253410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:55.254186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.254355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.254598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.256105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:55.256105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:55.256931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:55.266829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 568/1089] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:36:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:55.267888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f7cc34d2-18c6-46b9-b524-d48b21650684 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:55.269303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f7cc34d2-18c6-46b9-b524-d48b21650684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:55.275386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:55.349874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 522/1090] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:36:55.431396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16d14-6cfd-4943-ad51-a52b78b26c45 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:55.461960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:55.468234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c007852-f9be-47f9-8975-2ee994ee7af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:55.468922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007852-f9be-47f9-8975-2ee994ee7af8 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.469317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007852-f9be-47f9-8975-2ee994ee7af8 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.469734 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007852-f9be-47f9-8975-2ee994ee7af8 None admin] PATH_INFO: `/v3/users/e12ffd463fc54ac0bfbe5fb5cd2a6d1d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.470975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c007852-f9be-47f9-8975-2ee994ee7af8 None admin] RBAC: Authorizing `identity:get_user(user_id=e12ffd463fc54ac0bfbe5fb5cd2a6d1d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:55.472509 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c007852-f9be-47f9-8975-2ee994ee7af8 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:55.474343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 569/1091] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:36:55 2022] GET /identity/v3/users/e12ffd463fc54ac0bfbe5fb5cd2a6d1d => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:55.480141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc34d2-18c6-46b9-b524-d48b21650684 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:55.582005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc34d2-18c6-46b9-b524-d48b21650684 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:55.612924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:55.618011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c007852-f9be-47f9-8975-2ee994ee7af8 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:55.619947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f73d6-e7e7-4adb-8406-6f78e1312047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:55.620555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f73d6-e7e7-4adb-8406-6f78e1312047 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.621042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f73d6-e7e7-4adb-8406-6f78e1312047 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.621313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f73d6-e7e7-4adb-8406-6f78e1312047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.693193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f73d6-e7e7-4adb-8406-6f78e1312047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:55.694699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f73d6-e7e7-4adb-8406-6f78e1312047 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:55.733329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c007852-f9be-47f9-8975-2ee994ee7af8 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:55.789263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da9efb-4f1a-4e59-adec-2f9d5b22d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:55.790304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da9efb-4f1a-4e59-adec-2f9d5b22d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.790589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da9efb-4f1a-4e59-adec-2f9d5b22d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.790889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da9efb-4f1a-4e59-adec-2f9d5b22d0f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.800801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 523/1092] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:36:55.808382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da9efb-4f1a-4e59-adec-2f9d5b22d0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:36:55.809904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f73d6-e7e7-4adb-8406-6f78e1312047 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-77da9efb-4f1a-4e59-adec-2f9d5b22d0f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:36:55.813951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:55.815633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:55.816762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 570/1093] 10.222.0.30 () {56 vars in 1120 bytes} [Tue Oct 4 12:36:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:55.820998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da9efb-4f1a-4e59-adec-2f9d5b22d0f1 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:55.855293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:55.887874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:55.946461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f73d6-e7e7-4adb-8406-6f78e1312047 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:55.946759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da9efb-4f1a-4e59-adec-2f9d5b22d0f1 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:55.986904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee924c2-5301-4075-a0c8-1e17dff2ef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:55.987462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee924c2-5301-4075-a0c8-1e17dff2ef2f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.987740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee924c2-5301-4075-a0c8-1e17dff2ef2f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.988014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee924c2-5301-4075-a0c8-1e17dff2ef2f None admin] PATH_INFO: `/v3/projects/50b6f5d060524d47af764aac542a6fb7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.989161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee924c2-5301-4075-a0c8-1e17dff2ef2f None admin] RBAC: Authorizing `identity:get_project(project_id=50b6f5d060524d47af764aac542a6fb7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:55.990189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:55.990658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee924c2-5301-4075-a0c8-1e17dff2ef2f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:55.990790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:55.991182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:55.991459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:55.992132 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:55.992526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 524/1094] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:36:55 2022] GET /identity/v3/projects/50b6f5d060524d47af764aac542a6fb7 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:55.992646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:55.993993 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:55.998525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee924c2-5301-4075-a0c8-1e17dff2ef2f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:56.003655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 571/1095] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 4 12:36:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:56.010221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:56.119491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:56.123708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9085f83-bc7d-4025-8182-014c68f47a12 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:56.126683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee924c2-5301-4075-a0c8-1e17dff2ef2f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:56.147483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:56.160211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:56.160921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:56.161128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:56.161396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:56.173202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:56.174723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:56.177817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:56.178507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:56.178849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:56.179182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:56.179972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=50b6f5d060524d47af764aac542a6fb7, user.id=e12ffd463fc54ac0bfbe5fb5cd2a6d1d) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:56.180343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:56.182136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:56.189625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:56.190597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:56.191562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:56.191562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:56.191562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:56.191742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 525/1096] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:55 2022] GET /identity/v3/role_assignments?user.id=e12ffd463fc54ac0bfbe5fb5cd2a6d1d&scope.project.id=50b6f5d060524d47af764aac542a6fb7&role.id=b8bf66974c0448089a192ead432a35f2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:36:56.191831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 572/1097] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:36:56.196741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:56.318495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a367-8f71-4f73-9531-328ec80338ca None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:56.362189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:56.362826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:56.363108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:56.363386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:56.364105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:56.364513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:56.366045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:56.380085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 526/1098] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:56.386839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:56.518044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e02d08-073a-4c60-8711-81c700255bce None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:56.557061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:56.557743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:56.558030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:56.558310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:56.567508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:56.569057 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:36:56.584096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:56.585822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:36:56.586819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 573/1099] 10.222.0.30 () {56 vars in 1093 bytes} [Tue Oct 4 12:36:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:56.591808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:56.635440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:56.722913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f4136-08af-4e65-b761-8984af615c1a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:56.760256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:56.760889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:56.761174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:56.761454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:56.762265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:56.762582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:56.764103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:56.787491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 527/1100] 10.222.0.30 () {56 vars in 1133 bytes} [Tue Oct 4 12:36:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:56.793925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:56.837431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:56.919070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275d5f4-afbd-4657-a1b2-fd553181a48f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:56.964810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce30fec-9f42-4dd5-93a1-9c3f8d115a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:56.965409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30fec-9f42-4dd5-93a1-9c3f8d115a16 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:56.965730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30fec-9f42-4dd5-93a1-9c3f8d115a16 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:56.966007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30fec-9f42-4dd5-93a1-9c3f8d115a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:57.049360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce30fec-9f42-4dd5-93a1-9c3f8d115a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:57.050889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce30fec-9f42-4dd5-93a1-9c3f8d115a16 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:57.089373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:57.162259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 574/1101] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:36:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:36:57.169449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:57.253692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:57.275054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92806d28-5923-4891-a8d2-34b8d77cbd86 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:57.311411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:57.312281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:57.312710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:57.313650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:57.325643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:57.327134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:36:57.342918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:57.344425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:36:57.345639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:36:57.345639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:36:57.345639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:57.345639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 528/1102] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:57.351456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce30fec-9f42-4dd5-93a1-9c3f8d115a16 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:57.470736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce30fec-9f42-4dd5-93a1-9c3f8d115a16 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:57.510271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:57.510891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:57.511196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:57.511467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:57.512118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:57.512422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:57.513931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:57.515651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:57.527126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 575/1103] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:57.533186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:57.636763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4454b26-948b-416e-977a-f7b907b6ec7d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:57.669312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:57.675769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:57.676415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:57.676692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:57.676965 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:57.684127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:57.685582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:36:57.697344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:36:57.698358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:36:57.699265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 529/1104] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:36:57.704827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:57.833258 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb77aa8-7791-4c38-82f2-fa82b4966338 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:57.892539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10edee-1ab5-4dcb-b225-3f309abcae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:57.893521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10edee-1ab5-4dcb-b225-3f309abcae63 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:57.894036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10edee-1ab5-4dcb-b225-3f309abcae63 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:57.894534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10edee-1ab5-4dcb-b225-3f309abcae63 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:57.895848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10edee-1ab5-4dcb-b225-3f309abcae63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:57.896410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10edee-1ab5-4dcb-b225-3f309abcae63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:57.899029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10edee-1ab5-4dcb-b225-3f309abcae63 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:57.925040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 576/1105] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:57.926378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:58.038700 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cc176-cf50-42d9-b098-bb6b1245c483 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:58.078148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668276d-4bec-4253-abbd-f1ed352d19c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:58.078798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668276d-4bec-4253-abbd-f1ed352d19c5 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:58.079078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668276d-4bec-4253-abbd-f1ed352d19c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:58.079350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668276d-4bec-4253-abbd-f1ed352d19c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:58.080565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668276d-4bec-4253-abbd-f1ed352d19c5 None admin] RBAC: Adding query filter params (role.id=afda32e5fe2649aa9e427ff8657c62e0, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=175bb8ec9ccf487bb6e11f37bec82cb5) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:36:58.080565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668276d-4bec-4253-abbd-f1ed352d19c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:58.081993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668276d-4bec-4253-abbd-f1ed352d19c5 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:58.088613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 530/1106] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:36:57 2022] GET /identity/v3/role_assignments?user.id=175bb8ec9ccf487bb6e11f37bec82cb5&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=afda32e5fe2649aa9e427ff8657c62e0 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:58.467800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f1b22-9a85-43d6-a04e-245b59a59f03 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:58.468065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f1b22-9a85-43d6-a04e-245b59a59f03 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:58.468230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f1b22-9a85-43d6-a04e-245b59a59f03 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:58.470418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 577/1107] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:36:58.477549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432553b-5b47-4b88-80df-2b4758333499 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:58.478016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432553b-5b47-4b88-80df-2b4758333499 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:58.478359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432553b-5b47-4b88-80df-2b4758333499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:58.498076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2432553b-5b47-4b88-80df-2b4758333499 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:36:58.499285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2432553b-5b47-4b88-80df-2b4758333499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:36:58.560349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:58.581179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 531/1108] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:36:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:36:58.854823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f1b22-9a85-43d6-a04e-245b59a59f03 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:58.921932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:36:58.973349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f1b22-9a85-43d6-a04e-245b59a59f03 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:59.017542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0bfd7-52e6-4f9c-9b30-2d3e1d8227f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:59.018316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0bfd7-52e6-4f9c-9b30-2d3e1d8227f2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:59.018598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0bfd7-52e6-4f9c-9b30-2d3e1d8227f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:59.018873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0bfd7-52e6-4f9c-9b30-2d3e1d8227f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:59.020201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0bfd7-52e6-4f9c-9b30-2d3e1d8227f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:59.021870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0bfd7-52e6-4f9c-9b30-2d3e1d8227f2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:59.023626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 578/1109] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:36:59.030282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432553b-5b47-4b88-80df-2b4758333499 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:36:59.152672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432553b-5b47-4b88-80df-2b4758333499 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:36:59.187194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5a2af-be66-45a9-b3af-b7df41d89b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:36:59.187804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a2af-be66-45a9-b3af-b7df41d89b1d None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:36:59.188621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a2af-be66-45a9-b3af-b7df41d89b1d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:36:59.188890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a2af-be66-45a9-b3af-b7df41d89b1d None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:36:59.189549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5a2af-be66-45a9-b3af-b7df41d89b1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:36:59.191037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5a2af-be66-45a9-b3af-b7df41d89b1d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:36:59.212954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 532/1110] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:36:59 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:37:01.466647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9420c33-ecfa-48be-a16d-ed3bde1f015c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:01.467221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9420c33-ecfa-48be-a16d-ed3bde1f015c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:01.467221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9420c33-ecfa-48be-a16d-ed3bde1f015c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:01.468544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 579/1111] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:01.474063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee508ad-8482-47f3-a55c-f06321d6843e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:01.474507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee508ad-8482-47f3-a55c-f06321d6843e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:01.474649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee508ad-8482-47f3-a55c-f06321d6843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:01.492423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-eee508ad-8482-47f3-a55c-f06321d6843e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:01.493624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-eee508ad-8482-47f3-a55c-f06321d6843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:01.529244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:01.561536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 533/1112] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:37:01.829553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9420c33-ecfa-48be-a16d-ed3bde1f015c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:01.931541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9420c33-ecfa-48be-a16d-ed3bde1f015c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:01.959796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:01.972748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c069b1f-a928-4243-af2b-6a0afaf9645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:01.973394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069b1f-a928-4243-af2b-6a0afaf9645c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:01.973703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069b1f-a928-4243-af2b-6a0afaf9645c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:01.973972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c069b1f-a928-4243-af2b-6a0afaf9645c None admin] PATH_INFO: `/v3/roles/0adab6046ed34edf8914c4971198655f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:01.975414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c069b1f-a928-4243-af2b-6a0afaf9645c None admin] RBAC: Authorizing `identity:get_role(role_id=0adab6046ed34edf8914c4971198655f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:01.976781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c069b1f-a928-4243-af2b-6a0afaf9645c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:01.978178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 580/1113] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:01 2022] GET /identity/v3/roles/0adab6046ed34edf8914c4971198655f => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:01.984104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee508ad-8482-47f3-a55c-f06321d6843e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:02.083311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee508ad-8482-47f3-a55c-f06321d6843e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:02.116900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726e90-4720-4f3d-b4e4-3864551d8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:02.117532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726e90-4720-4f3d-b4e4-3864551d8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:02.117852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726e90-4720-4f3d-b4e4-3864551d8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:02.118127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726e90-4720-4f3d-b4e4-3864551d8bb9 None admin] PATH_INFO: `/v3/users/15ef6379c0ed46779a76c25bea1a00dc` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:02.133298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da726e90-4720-4f3d-b4e4-3864551d8bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=15ef6379c0ed46779a76c25bea1a00dc)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:02.134842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da726e90-4720-4f3d-b4e4-3864551d8bb9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:02.136628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 534/1114] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:01 2022] GET /identity/v3/users/15ef6379c0ed46779a76c25bea1a00dc => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:02.142912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c069b1f-a928-4243-af2b-6a0afaf9645c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:02.250854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c069b1f-a928-4243-af2b-6a0afaf9645c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:02.287785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b0ec-56bd-405a-8933-a633a5024b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:02.288397 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b0ec-56bd-405a-8933-a633a5024b7b None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:02.288677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b0ec-56bd-405a-8933-a633a5024b7b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:02.288948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b0ec-56bd-405a-8933-a633a5024b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:02.348566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:02.360990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b0ec-56bd-405a-8933-a633a5024b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:02.362489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b0ec-56bd-405a-8933-a633a5024b7b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:02.473450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 581/1115] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:37:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:37:02.479748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726e90-4720-4f3d-b4e4-3864551d8bb9 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:02.511854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:02.581579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726e90-4720-4f3d-b4e4-3864551d8bb9 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:02.616064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e930af-6c1f-4a22-8b4f-9819e3bb7e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:02.616692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e930af-6c1f-4a22-8b4f-9819e3bb7e30 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:02.616973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e930af-6c1f-4a22-8b4f-9819e3bb7e30 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:02.617249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e930af-6c1f-4a22-8b4f-9819e3bb7e30 None admin] PATH_INFO: `/v3/projects/50b6f5d060524d47af764aac542a6fb7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:02.618413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e930af-6c1f-4a22-8b4f-9819e3bb7e30 None admin] RBAC: Authorizing `identity:get_project(project_id=50b6f5d060524d47af764aac542a6fb7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:02.619852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e930af-6c1f-4a22-8b4f-9819e3bb7e30 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:02.621506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 535/1116] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:02 2022] GET /identity/v3/projects/50b6f5d060524d47af764aac542a6fb7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:02.628045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b0ec-56bd-405a-8933-a633a5024b7b None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:02.720008 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:02.730055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b0ec-56bd-405a-8933-a633a5024b7b None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:02.763140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3e585-a876-4d45-95eb-6ad9a8083c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:02.763750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3e585-a876-4d45-95eb-6ad9a8083c80 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:02.764029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3e585-a876-4d45-95eb-6ad9a8083c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:02.764300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3e585-a876-4d45-95eb-6ad9a8083c80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:02.765025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3e585-a876-4d45-95eb-6ad9a8083c80 None admin] RBAC: Adding query filter params (role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=50b6f5d060524d47af764aac542a6fb7, user.id=15ef6379c0ed46779a76c25bea1a00dc) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:02.765334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3e585-a876-4d45-95eb-6ad9a8083c80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:02.767344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3e585-a876-4d45-95eb-6ad9a8083c80 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:02.772948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 582/1117] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:37:02 2022] GET /identity/v3/role_assignments?user.id=15ef6379c0ed46779a76c25bea1a00dc&scope.project.id=50b6f5d060524d47af764aac542a6fb7&role.id=0adab6046ed34edf8914c4971198655f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:04.945813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15772d6-e8ef-4999-9616-f435f1edc304 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:04.946401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15772d6-e8ef-4999-9616-f435f1edc304 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:04.946401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15772d6-e8ef-4999-9616-f435f1edc304 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:04.947774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 536/1118] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:04.953848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db83f-0d8b-4968-955b-560eaf5650f6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:04.954413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db83f-0d8b-4968-955b-560eaf5650f6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:04.954413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32db83f-0d8b-4968-955b-560eaf5650f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:04.973721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d32db83f-0d8b-4968-955b-560eaf5650f6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:04.974966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d32db83f-0d8b-4968-955b-560eaf5650f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:05.046484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 583/1119] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:37:05.317270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15772d6-e8ef-4999-9616-f435f1edc304 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:05.412876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:05.418470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15772d6-e8ef-4999-9616-f435f1edc304 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:05.452645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55783bc6-a2dd-4774-8fe7-6d7ba25d0a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:05.453279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783bc6-a2dd-4774-8fe7-6d7ba25d0a98 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:05.454187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783bc6-a2dd-4774-8fe7-6d7ba25d0a98 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:05.454464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55783bc6-a2dd-4774-8fe7-6d7ba25d0a98 None admin] PATH_INFO: `/v3/roles/0adab6046ed34edf8914c4971198655f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:05.455854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55783bc6-a2dd-4774-8fe7-6d7ba25d0a98 None admin] RBAC: Authorizing `identity:get_role(role_id=0adab6046ed34edf8914c4971198655f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:05.457222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55783bc6-a2dd-4774-8fe7-6d7ba25d0a98 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:05.458587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 537/1120] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:05 2022] GET /identity/v3/roles/0adab6046ed34edf8914c4971198655f => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:05.464491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32db83f-0d8b-4968-955b-560eaf5650f6 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:05.544575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:05.560277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32db83f-0d8b-4968-955b-560eaf5650f6 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:05.593163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3f6e-896f-4cb0-931f-f09cd4310e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:05.593742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3f6e-896f-4cb0-931f-f09cd4310e65 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:05.594023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3f6e-896f-4cb0-931f-f09cd4310e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:05.594295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3f6e-896f-4cb0-931f-f09cd4310e65 None admin] PATH_INFO: `/v3/users/15ef6379c0ed46779a76c25bea1a00dc` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:05.595401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e3f6e-896f-4cb0-931f-f09cd4310e65 None admin] RBAC: Authorizing `identity:get_user(user_id=15ef6379c0ed46779a76c25bea1a00dc)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:05.596844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e3f6e-896f-4cb0-931f-f09cd4310e65 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:05.598457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 584/1121] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:05 2022] GET /identity/v3/users/15ef6379c0ed46779a76c25bea1a00dc => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:05.604316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55783bc6-a2dd-4774-8fe7-6d7ba25d0a98 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:05.702337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55783bc6-a2dd-4774-8fe7-6d7ba25d0a98 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:05.734394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacac6b-4b82-475c-871e-2cd7fa22ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:05.735544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacac6b-4b82-475c-871e-2cd7fa22ced3 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:05.735823 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacac6b-4b82-475c-871e-2cd7fa22ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:05.736096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacac6b-4b82-475c-871e-2cd7fa22ced3 None admin] PATH_INFO: `/v3/projects/50b6f5d060524d47af764aac542a6fb7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:05.737208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacac6b-4b82-475c-871e-2cd7fa22ced3 None admin] RBAC: Authorizing `identity:get_project(project_id=50b6f5d060524d47af764aac542a6fb7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:05.738672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacac6b-4b82-475c-871e-2cd7fa22ced3 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:05.740313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 538/1122] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:05 2022] GET /identity/v3/projects/50b6f5d060524d47af764aac542a6fb7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:05.746387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3f6e-896f-4cb0-931f-f09cd4310e65 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:05.853811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3f6e-896f-4cb0-931f-f09cd4310e65 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:05.887617 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dada9-5300-4302-877e-98e5e85244ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:05.888277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dada9-5300-4302-877e-98e5e85244ce None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:05.888562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dada9-5300-4302-877e-98e5e85244ce None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:05.888840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dada9-5300-4302-877e-98e5e85244ce None admin] PATH_INFO: `/v3/projects/50b6f5d060524d47af764aac542a6fb7/users/15ef6379c0ed46779a76c25bea1a00dc/roles/0adab6046ed34edf8914c4971198655f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:05.891191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dada9-5300-4302-877e-98e5e85244ce None admin] RBAC: Authorizing `identity:create_grant(project_id=50b6f5d060524d47af764aac542a6fb7, user_id=15ef6379c0ed46779a76c25bea1a00dc, role_id=0adab6046ed34edf8914c4971198655f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:05.892455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dada9-5300-4302-877e-98e5e85244ce None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:05.905813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 585/1123] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:37:05 2022] PUT /identity/v3/projects/50b6f5d060524d47af764aac542a6fb7/users/15ef6379c0ed46779a76c25bea1a00dc/roles/0adab6046ed34edf8914c4971198655f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:37:08.060227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89a9e-1a85-4e76-805e-224cba40b673 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:08.060779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89a9e-1a85-4e76-805e-224cba40b673 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:08.060874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89a9e-1a85-4e76-805e-224cba40b673 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:08.062199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 539/1124] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:08.068228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a472ad-704b-41b2-808f-803b41822754 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:08.068651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a472ad-704b-41b2-808f-803b41822754 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:08.068771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a472ad-704b-41b2-808f-803b41822754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:08.087924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-87a472ad-704b-41b2-808f-803b41822754 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:08.089119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-87a472ad-704b-41b2-808f-803b41822754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:08.097763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:08.159123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 586/1125] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:08.428653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b89a9e-1a85-4e76-805e-224cba40b673 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:08.463328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:08.532741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b89a9e-1a85-4e76-805e-224cba40b673 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:08.566907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6098e03-cf66-471e-b980-092174a32cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:08.567548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6098e03-cf66-471e-b980-092174a32cae None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:08.567832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6098e03-cf66-471e-b980-092174a32cae None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:08.568108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6098e03-cf66-471e-b980-092174a32cae None admin] PATH_INFO: `/v3/roles/0adab6046ed34edf8914c4971198655f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:08.569505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6098e03-cf66-471e-b980-092174a32cae None admin] RBAC: Authorizing `identity:get_role(role_id=0adab6046ed34edf8914c4971198655f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:08.570912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6098e03-cf66-471e-b980-092174a32cae None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:08.572256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 540/1126] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:08 2022] GET /identity/v3/roles/0adab6046ed34edf8914c4971198655f => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:08.578258 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a472ad-704b-41b2-808f-803b41822754 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:08.680613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a472ad-704b-41b2-808f-803b41822754 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:08.715145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abce9-f92e-4ab5-a5ab-235acf084266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:08.715778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abce9-f92e-4ab5-a5ab-235acf084266 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:08.716059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abce9-f92e-4ab5-a5ab-235acf084266 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:08.716330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abce9-f92e-4ab5-a5ab-235acf084266 None admin] PATH_INFO: `/v3/users/15ef6379c0ed46779a76c25bea1a00dc` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:08.717455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9abce9-f92e-4ab5-a5ab-235acf084266 None admin] RBAC: Authorizing `identity:get_user(user_id=15ef6379c0ed46779a76c25bea1a00dc)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:08.718937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9abce9-f92e-4ab5-a5ab-235acf084266 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:08.721077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 587/1127] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:08 2022] GET /identity/v3/users/15ef6379c0ed46779a76c25bea1a00dc => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:37:08.726918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6098e03-cf66-471e-b980-092174a32cae None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:08.839879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6098e03-cf66-471e-b980-092174a32cae None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:08.841395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:08.875800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa19aa-15b0-4c63-97c5-cfe876b37f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:08.876415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa19aa-15b0-4c63-97c5-cfe876b37f2a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:08.876698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa19aa-15b0-4c63-97c5-cfe876b37f2a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:08.876978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa19aa-15b0-4c63-97c5-cfe876b37f2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:08.946158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa19aa-15b0-4c63-97c5-cfe876b37f2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:08.947537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa19aa-15b0-4c63-97c5-cfe876b37f2a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:09.045951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 541/1128] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:37:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:37:09.052426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abce9-f92e-4ab5-a5ab-235acf084266 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:09.067962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:09.165779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abce9-f92e-4ab5-a5ab-235acf084266 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:09.200104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d935aa2-a862-4964-812b-a6fba386c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:09.200650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d935aa2-a862-4964-812b-a6fba386c1cf None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:09.200932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d935aa2-a862-4964-812b-a6fba386c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:09.201214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d935aa2-a862-4964-812b-a6fba386c1cf None admin] PATH_INFO: `/v3/projects/50b6f5d060524d47af764aac542a6fb7` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:09.202398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d935aa2-a862-4964-812b-a6fba386c1cf None admin] RBAC: Authorizing `identity:get_project(project_id=50b6f5d060524d47af764aac542a6fb7)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:09.204488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d935aa2-a862-4964-812b-a6fba386c1cf None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:09.206173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 588/1129] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:09 2022] GET /identity/v3/projects/50b6f5d060524d47af764aac542a6fb7 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:09.213650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa19aa-15b0-4c63-97c5-cfe876b37f2a None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:09.215828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:09.316113 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa19aa-15b0-4c63-97c5-cfe876b37f2a None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:09.350271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63182ae4-2366-4816-9e34-0b0dcc6a4150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:09.350886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182ae4-2366-4816-9e34-0b0dcc6a4150 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:09.351172 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182ae4-2366-4816-9e34-0b0dcc6a4150 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:09.351449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182ae4-2366-4816-9e34-0b0dcc6a4150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:09.352186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63182ae4-2366-4816-9e34-0b0dcc6a4150 None admin] RBAC: Adding query filter params (role.id=0adab6046ed34edf8914c4971198655f, scope.project.id=50b6f5d060524d47af764aac542a6fb7, user.id=15ef6379c0ed46779a76c25bea1a00dc) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:09.352497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63182ae4-2366-4816-9e34-0b0dcc6a4150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:09.353964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63182ae4-2366-4816-9e34-0b0dcc6a4150 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:09.360784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 542/1130] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:37:09 2022] GET /identity/v3/role_assignments?user.id=15ef6379c0ed46779a76c25bea1a00dc&scope.project.id=50b6f5d060524d47af764aac542a6fb7&role.id=0adab6046ed34edf8914c4971198655f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:37:11.594104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e008cd1-546b-4404-abe2-bc2e6f14a4d2 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:11.594647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e008cd1-546b-4404-abe2-bc2e6f14a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:11.594647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e008cd1-546b-4404-abe2-bc2e6f14a4d2 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:11.596028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 589/1131] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:11.601247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031ee4-ee57-4f42-8a32-f55d6308ac67 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:11.601710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031ee4-ee57-4f42-8a32-f55d6308ac67 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:11.601803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031ee4-ee57-4f42-8a32-f55d6308ac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:11.619916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-60031ee4-ee57-4f42-8a32-f55d6308ac67 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:11.621079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-60031ee4-ee57-4f42-8a32-f55d6308ac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:11.680475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:11.688724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 543/1132] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:11.965545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e008cd1-546b-4404-abe2-bc2e6f14a4d2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:12.048776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:12.070536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e008cd1-546b-4404-abe2-bc2e6f14a4d2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:12.102460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d682a3-2c38-489a-8cf7-cf6fec03b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:12.103072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d682a3-2c38-489a-8cf7-cf6fec03b46c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:12.103345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d682a3-2c38-489a-8cf7-cf6fec03b46c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:12.103613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d682a3-2c38-489a-8cf7-cf6fec03b46c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:12.104699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d682a3-2c38-489a-8cf7-cf6fec03b46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:12.106156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d682a3-2c38-489a-8cf7-cf6fec03b46c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:12.107704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 590/1133] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:12.114223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60031ee4-ee57-4f42-8a32-f55d6308ac67 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:12.207657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60031ee4-ee57-4f42-8a32-f55d6308ac67 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:12.240787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471ccc3-1180-4ffc-b569-f462b487e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:12.241306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471ccc3-1180-4ffc-b569-f462b487e6b1 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:12.241583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471ccc3-1180-4ffc-b569-f462b487e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:12.241882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471ccc3-1180-4ffc-b569-f462b487e6b1 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:12.242516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471ccc3-1180-4ffc-b569-f462b487e6b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:12.243933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471ccc3-1180-4ffc-b569-f462b487e6b1 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:12.270275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 544/1134] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:37:12 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:37:14.477175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b6b6-10de-443b-98a2-0d4f86c22db8 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:14.477746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b6b6-10de-443b-98a2-0d4f86c22db8 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:14.477746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23b6b6-10de-443b-98a2-0d4f86c22db8 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:14.479097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 591/1135] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:14.485058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb366-ecd8-4261-8954-9ecad287dcfa None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:14.485473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb366-ecd8-4261-8954-9ecad287dcfa None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:14.485709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb366-ecd8-4261-8954-9ecad287dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:14.504071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-67acb366-ecd8-4261-8954-9ecad287dcfa None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:14.505256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-67acb366-ecd8-4261-8954-9ecad287dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:14.548587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:14.572457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 545/1136] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:14.838567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23b6b6-10de-443b-98a2-0d4f86c22db8 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:14.939800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23b6b6-10de-443b-98a2-0d4f86c22db8 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:14.973563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5babdfb-754c-4a26-872d-f6b9ac7410c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:14.974211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5babdfb-754c-4a26-872d-f6b9ac7410c4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:14.974488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5babdfb-754c-4a26-872d-f6b9ac7410c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:14.974780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5babdfb-754c-4a26-872d-f6b9ac7410c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:14.975871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5babdfb-754c-4a26-872d-f6b9ac7410c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:14.977281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5babdfb-754c-4a26-872d-f6b9ac7410c4 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:14.979862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 592/1137] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:14.986236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb366-ecd8-4261-8954-9ecad287dcfa None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:15.085019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb366-ecd8-4261-8954-9ecad287dcfa None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:15.119057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19025204-c08c-41ee-8ec1-8b55fb484408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:15.119652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19025204-c08c-41ee-8ec1-8b55fb484408 None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:15.119930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19025204-c08c-41ee-8ec1-8b55fb484408 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:15.120201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19025204-c08c-41ee-8ec1-8b55fb484408 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:15.120839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19025204-c08c-41ee-8ec1-8b55fb484408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:15.122289 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19025204-c08c-41ee-8ec1-8b55fb484408 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:15.142571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 546/1138] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:37:14 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:37:17.334158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f5a9-58f8-405a-8d38-84905b182d45 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:17.334729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f5a9-58f8-405a-8d38-84905b182d45 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:17.334729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91f5a9-58f8-405a-8d38-84905b182d45 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:17.336035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 593/1139] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:17.341518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05d0bc-e92b-4a92-b985-7a5e74cc5168 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:17.341952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05d0bc-e92b-4a92-b985-7a5e74cc5168 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:17.342101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05d0bc-e92b-4a92-b985-7a5e74cc5168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:17.361291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fb05d0bc-e92b-4a92-b985-7a5e74cc5168 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:17.362515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fb05d0bc-e92b-4a92-b985-7a5e74cc5168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:17.389307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:17.433383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 547/1140] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:17.708181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91f5a9-58f8-405a-8d38-84905b182d45 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:17.724188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:17.807224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91f5a9-58f8-405a-8d38-84905b182d45 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:17.840367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98e1b7-db7f-4f14-8b4e-301618f90274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:17.840999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98e1b7-db7f-4f14-8b4e-301618f90274 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:17.841281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98e1b7-db7f-4f14-8b4e-301618f90274 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:17.841559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98e1b7-db7f-4f14-8b4e-301618f90274 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:17.852268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98e1b7-db7f-4f14-8b4e-301618f90274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-0d98e1b7-db7f-4f14-8b4e-301618f90274 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:37:17.857063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:37:17.858099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:37:17.858944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 594/1141] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:37:17.864400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05d0bc-e92b-4a92-b985-7a5e74cc5168 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:17.971712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05d0bc-e92b-4a92-b985-7a5e74cc5168 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:18.004384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:18.005008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:18.005286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:18.005555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:18.006545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:18.006849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:18.008265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:18.017582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 548/1142] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:18.023610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98e1b7-db7f-4f14-8b4e-301618f90274 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:18.097885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:18.122010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98e1b7-db7f-4f14-8b4e-301618f90274 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:18.156190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eda4f9-2e39-4b62-91c5-9ced21a3f5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:18.156843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eda4f9-2e39-4b62-91c5-9ced21a3f5be None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:18.157125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eda4f9-2e39-4b62-91c5-9ced21a3f5be None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:18.157396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eda4f9-2e39-4b62-91c5-9ced21a3f5be None admin] PATH_INFO: `/v3/users/5dd9a0ed4cb54cbbb666525fe77ce5db` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:18.170279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eda4f9-2e39-4b62-91c5-9ced21a3f5be None admin] RBAC: Authorizing `identity:get_user(user_id=5dd9a0ed4cb54cbbb666525fe77ce5db)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:18.171711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eda4f9-2e39-4b62-91c5-9ced21a3f5be None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:18.173348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 595/1143] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:18 2022] GET /identity/v3/users/5dd9a0ed4cb54cbbb666525fe77ce5db => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:18.179300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:18.207243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:18.282785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9398-a6b5-4037-ac2c-9f15aef51262 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:18.315603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349b67a-5ac6-4cf6-9e74-90661dbad428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:18.316205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b67a-5ac6-4cf6-9e74-90661dbad428 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:18.316492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b67a-5ac6-4cf6-9e74-90661dbad428 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:18.316769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b67a-5ac6-4cf6-9e74-90661dbad428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:18.380579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349b67a-5ac6-4cf6-9e74-90661dbad428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:18.382057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349b67a-5ac6-4cf6-9e74-90661dbad428 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:18.406753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:18.476692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 549/1144] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:37:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:37:18.482588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eda4f9-2e39-4b62-91c5-9ced21a3f5be None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:18.579128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eda4f9-2e39-4b62-91c5-9ced21a3f5be None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:18.606851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:18.612969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601de4-e91b-4e56-84ce-5e7251861ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:18.613632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601de4-e91b-4e56-84ce-5e7251861ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:18.613920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601de4-e91b-4e56-84ce-5e7251861ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:18.614193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601de4-e91b-4e56-84ce-5e7251861ff1 None admin] PATH_INFO: `/v3/projects/844f26cad20341a9a96580ae9acb84fa` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:18.615307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601de4-e91b-4e56-84ce-5e7251861ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=844f26cad20341a9a96580ae9acb84fa)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:18.616733 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601de4-e91b-4e56-84ce-5e7251861ff1 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:18.618409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 596/1145] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:18 2022] GET /identity/v3/projects/844f26cad20341a9a96580ae9acb84fa => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:18.624531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349b67a-5ac6-4cf6-9e74-90661dbad428 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:18.720918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349b67a-5ac6-4cf6-9e74-90661dbad428 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:18.745803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:18.754554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c2eb6-eba8-4bb1-b822-552e0a80f3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:18.755158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c2eb6-eba8-4bb1-b822-552e0a80f3ed None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:18.755439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c2eb6-eba8-4bb1-b822-552e0a80f3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:18.755711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c2eb6-eba8-4bb1-b822-552e0a80f3ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:18.756431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c2eb6-eba8-4bb1-b822-552e0a80f3ed None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=844f26cad20341a9a96580ae9acb84fa, user.id=5dd9a0ed4cb54cbbb666525fe77ce5db) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:18.756742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c2eb6-eba8-4bb1-b822-552e0a80f3ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:18.758209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c2eb6-eba8-4bb1-b822-552e0a80f3ed None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:18.763447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 550/1146] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:37:18 2022] GET /identity/v3/role_assignments?user.id=5dd9a0ed4cb54cbbb666525fe77ce5db&scope.project.id=844f26cad20341a9a96580ae9acb84fa&role.id=b8bf66974c0448089a192ead432a35f2 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:20.924929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5fbf-9e13-4b24-9694-5d2881f1a953 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:20.925530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5fbf-9e13-4b24-9694-5d2881f1a953 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:20.925530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee5fbf-9e13-4b24-9694-5d2881f1a953 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:20.926828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 597/1147] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:20.931986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1d1a-743a-40f9-a102-661ba5a80a1a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:20.932419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1d1a-743a-40f9-a102-661ba5a80a1a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:20.932518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1d1a-743a-40f9-a102-661ba5a80a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:20.951305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f22c1d1a-743a-40f9-a102-661ba5a80a1a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:20.952492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f22c1d1a-743a-40f9-a102-661ba5a80a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:21.018203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 551/1148] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:21.287892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee5fbf-9e13-4b24-9694-5d2881f1a953 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:21.387998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee5fbf-9e13-4b24-9694-5d2881f1a953 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:21.421605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e6385-598b-4d79-87d7-49f40f12a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:21.422279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6385-598b-4d79-87d7-49f40f12a918 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:21.422560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6385-598b-4d79-87d7-49f40f12a918 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:21.422837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e6385-598b-4d79-87d7-49f40f12a918 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:21.432826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e6385-598b-4d79-87d7-49f40f12a918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-c75e6385-598b-4d79-87d7-49f40f12a918 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:37:21.437580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:37:21.438772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:37:21.439662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 598/1149] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:37:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:37:21.444806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1d1a-743a-40f9-a102-661ba5a80a1a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:21.540538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1d1a-743a-40f9-a102-661ba5a80a1a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:21.560463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:21.575067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:21.575667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:21.575945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:21.576215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:21.576867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:21.577170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:21.578553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:21.586429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 552/1150] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:37:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:21.592289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e6385-598b-4d79-87d7-49f40f12a918 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:21.650504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:21.692147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e6385-598b-4d79-87d7-49f40f12a918 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:21.724829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7034d3-3942-42ab-8c5f-4fda63a9ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:21.725450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7034d3-3942-42ab-8c5f-4fda63a9ccee None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:21.725762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7034d3-3942-42ab-8c5f-4fda63a9ccee None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:21.726039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7034d3-3942-42ab-8c5f-4fda63a9ccee None admin] PATH_INFO: `/v3/users/5dd9a0ed4cb54cbbb666525fe77ce5db` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:21.727155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7034d3-3942-42ab-8c5f-4fda63a9ccee None admin] RBAC: Authorizing `identity:get_user(user_id=5dd9a0ed4cb54cbbb666525fe77ce5db)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:21.728584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7034d3-3942-42ab-8c5f-4fda63a9ccee None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:21.730184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 599/1151] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:21 2022] GET /identity/v3/users/5dd9a0ed4cb54cbbb666525fe77ce5db => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:21.736581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:21.832666 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f049ae7-c116-4864-8e4a-26f1cdfa06e2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:21.865281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3c405-ea2b-425a-8ac6-abc08aaf0f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:21.865924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c405-ea2b-425a-8ac6-abc08aaf0f51 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:21.866204 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c405-ea2b-425a-8ac6-abc08aaf0f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:21.866474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c405-ea2b-425a-8ac6-abc08aaf0f51 None admin] PATH_INFO: `/v3/projects/844f26cad20341a9a96580ae9acb84fa` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:21.867563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3c405-ea2b-425a-8ac6-abc08aaf0f51 None admin] RBAC: Authorizing `identity:get_project(project_id=844f26cad20341a9a96580ae9acb84fa)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:21.868989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3c405-ea2b-425a-8ac6-abc08aaf0f51 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:21.870629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 553/1152] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:21 2022] GET /identity/v3/projects/844f26cad20341a9a96580ae9acb84fa => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:21.876577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7034d3-3942-42ab-8c5f-4fda63a9ccee None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:21.974210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7034d3-3942-42ab-8c5f-4fda63a9ccee None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:22.000598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:22.008768 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cf32d-8da9-401f-8ba7-707dbc4dab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:22.009420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cf32d-8da9-401f-8ba7-707dbc4dab29 None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:22.009729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cf32d-8da9-401f-8ba7-707dbc4dab29 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:22.010005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cf32d-8da9-401f-8ba7-707dbc4dab29 None admin] PATH_INFO: `/v3/projects/844f26cad20341a9a96580ae9acb84fa/users/5dd9a0ed4cb54cbbb666525fe77ce5db/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:22.011866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cf32d-8da9-401f-8ba7-707dbc4dab29 None admin] RBAC: Authorizing `identity:create_grant(project_id=844f26cad20341a9a96580ae9acb84fa, user_id=5dd9a0ed4cb54cbbb666525fe77ce5db, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:22.013290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cf32d-8da9-401f-8ba7-707dbc4dab29 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:22.026888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 600/1153] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:37:21 2022] PUT /identity/v3/projects/844f26cad20341a9a96580ae9acb84fa/users/5dd9a0ed4cb54cbbb666525fe77ce5db/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:37:24.145690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cac28-5876-49a1-9ec6-392764dec852 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:24.146267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cac28-5876-49a1-9ec6-392764dec852 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:24.146267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cac28-5876-49a1-9ec6-392764dec852 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:24.147620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 554/1154] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:24.153100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a6b1-a32f-4b68-b0d3-44474d572337 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:24.153548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a6b1-a32f-4b68-b0d3-44474d572337 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:24.153674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a6b1-a32f-4b68-b0d3-44474d572337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:24.171927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0610a6b1-a32f-4b68-b0d3-44474d572337 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:24.173648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0610a6b1-a32f-4b68-b0d3-44474d572337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:24.238622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 601/1155] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:24.508779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cac28-5876-49a1-9ec6-392764dec852 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:24.558660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:24.610070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cac28-5876-49a1-9ec6-392764dec852 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:24.643422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbbd9-be37-4d0b-897e-26739d37b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:24.644053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbbd9-be37-4d0b-897e-26739d37b671 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:24.644332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbbd9-be37-4d0b-897e-26739d37b671 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:24.644604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbbd9-be37-4d0b-897e-26739d37b671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:24.654822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dbbd9-be37-4d0b-897e-26739d37b671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-571dbbd9-be37-4d0b-897e-26739d37b671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:37:24.660047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:37:24.661146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:37:24.662193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 555/1156] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:37:24.667275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610a6b1-a32f-4b68-b0d3-44474d572337 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:24.767845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610a6b1-a32f-4b68-b0d3-44474d572337 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:24.784535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:24.801373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:24.802007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:24.802293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:24.802569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:24.803230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:24.803538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:24.804911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:24.813156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 602/1157] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:24.819268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbbd9-be37-4d0b-897e-26739d37b671 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:24.915844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbbd9-be37-4d0b-897e-26739d37b671 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:24.926216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:24.949975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c6689-fa75-4b0d-8e0f-a970f24adc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:24.950594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6689-fa75-4b0d-8e0f-a970f24adc62 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:24.950873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6689-fa75-4b0d-8e0f-a970f24adc62 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:24.951144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6689-fa75-4b0d-8e0f-a970f24adc62 None admin] PATH_INFO: `/v3/users/5dd9a0ed4cb54cbbb666525fe77ce5db` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:24.952246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c6689-fa75-4b0d-8e0f-a970f24adc62 None admin] RBAC: Authorizing `identity:get_user(user_id=5dd9a0ed4cb54cbbb666525fe77ce5db)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:24.954301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c6689-fa75-4b0d-8e0f-a970f24adc62 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:24.955867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 556/1158] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:24 2022] GET /identity/v3/users/5dd9a0ed4cb54cbbb666525fe77ce5db => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:24.961651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:25.060135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66daec-89c0-4de8-8eff-1618d1161b93 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:25.092753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73fb89-61bb-4669-b40f-407b278531fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:25.093357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73fb89-61bb-4669-b40f-407b278531fe None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:25.094306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73fb89-61bb-4669-b40f-407b278531fe None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:25.094586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73fb89-61bb-4669-b40f-407b278531fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:25.140180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:25.160358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73fb89-61bb-4669-b40f-407b278531fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:25.161834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73fb89-61bb-4669-b40f-407b278531fe None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:25.255567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 603/1159] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:37:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:37:25.261431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c6689-fa75-4b0d-8e0f-a970f24adc62 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:25.358815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c6689-fa75-4b0d-8e0f-a970f24adc62 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:25.391728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e92586-2d12-4b00-baac-689053574556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:25.392357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92586-2d12-4b00-baac-689053574556 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:25.392639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92586-2d12-4b00-baac-689053574556 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:25.392913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92586-2d12-4b00-baac-689053574556 None admin] PATH_INFO: `/v3/projects/844f26cad20341a9a96580ae9acb84fa` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:25.394058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e92586-2d12-4b00-baac-689053574556 None admin] RBAC: Authorizing `identity:get_project(project_id=844f26cad20341a9a96580ae9acb84fa)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:25.395505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e92586-2d12-4b00-baac-689053574556 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:25.397295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 557/1160] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:25 2022] GET /identity/v3/projects/844f26cad20341a9a96580ae9acb84fa => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:25.403816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73fb89-61bb-4669-b40f-407b278531fe None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:25.482864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:25.502249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73fb89-61bb-4669-b40f-407b278531fe None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:25.535328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f26eef-83e0-4cc7-b95e-a39eea6cd34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:25.535853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f26eef-83e0-4cc7-b95e-a39eea6cd34c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:25.536131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f26eef-83e0-4cc7-b95e-a39eea6cd34c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:25.536400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f26eef-83e0-4cc7-b95e-a39eea6cd34c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:25.537125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f26eef-83e0-4cc7-b95e-a39eea6cd34c None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=844f26cad20341a9a96580ae9acb84fa, user.id=5dd9a0ed4cb54cbbb666525fe77ce5db) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:25.537425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f26eef-83e0-4cc7-b95e-a39eea6cd34c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:25.538873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f26eef-83e0-4cc7-b95e-a39eea6cd34c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:25.544496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 604/1161] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:37:25 2022] GET /identity/v3/role_assignments?user.id=5dd9a0ed4cb54cbbb666525fe77ce5db&scope.project.id=844f26cad20341a9a96580ae9acb84fa&role.id=b8bf66974c0448089a192ead432a35f2 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:27.701767 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c12a-1b6f-48c0-9d90-e24a16f13656 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:27.702290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c12a-1b6f-48c0-9d90-e24a16f13656 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:27.702290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204c12a-1b6f-48c0-9d90-e24a16f13656 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:27.703659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 558/1162] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:27.708761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56145-29f7-43c3-9f39-6ac7e43150c1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:27.709181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56145-29f7-43c3-9f39-6ac7e43150c1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:27.709320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56145-29f7-43c3-9f39-6ac7e43150c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:27.728271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-05f56145-29f7-43c3-9f39-6ac7e43150c1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:27.729455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-05f56145-29f7-43c3-9f39-6ac7e43150c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:27.794463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 605/1163] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:28.059892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204c12a-1b6f-48c0-9d90-e24a16f13656 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:28.108522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:28.161944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204c12a-1b6f-48c0-9d90-e24a16f13656 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:28.195058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11c692-ec53-4f70-bcb6-972804f45c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:28.195658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11c692-ec53-4f70-bcb6-972804f45c7e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:28.195935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11c692-ec53-4f70-bcb6-972804f45c7e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:28.196206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11c692-ec53-4f70-bcb6-972804f45c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:28.260652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11c692-ec53-4f70-bcb6-972804f45c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:28.262162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11c692-ec53-4f70-bcb6-972804f45c7e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:28.306595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:28.358460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 559/1164] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:37:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:37:28.365052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f56145-29f7-43c3-9f39-6ac7e43150c1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:28.438160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:28.463030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f56145-29f7-43c3-9f39-6ac7e43150c1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:28.496703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc45fb-e4fb-4787-8406-37deac59720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:28.497332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc45fb-e4fb-4787-8406-37deac59720d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:28.497645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc45fb-e4fb-4787-8406-37deac59720d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:28.497921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc45fb-e4fb-4787-8406-37deac59720d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:28.504669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc45fb-e4fb-4787-8406-37deac59720d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:28.506149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc45fb-e4fb-4787-8406-37deac59720d None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a9bc45fb-e4fb-4787-8406-37deac59720d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:37:28.517672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:37:28.518895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:37:28.519949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 606/1165] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:37:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:37:28.525064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11c692-ec53-4f70-bcb6-972804f45c7e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:28.621083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11c692-ec53-4f70-bcb6-972804f45c7e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:28.654212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e36d-e7a2-431b-8e2a-03b8e2ea101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:28.654812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e36d-e7a2-431b-8e2a-03b8e2ea101a None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:28.655089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e36d-e7a2-431b-8e2a-03b8e2ea101a None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:28.655358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e36d-e7a2-431b-8e2a-03b8e2ea101a None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:28.656510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e36d-e7a2-431b-8e2a-03b8e2ea101a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:28.656815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e36d-e7a2-431b-8e2a-03b8e2ea101a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:28.658208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e36d-e7a2-431b-8e2a-03b8e2ea101a None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:28.665166 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 560/1166] 10.222.0.30 () {56 vars in 1115 bytes} [Tue Oct 4 12:37:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:30.828172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7dcb-bec1-4e48-9299-fb9f9c6d58dc None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:30.828706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7dcb-bec1-4e48-9299-fb9f9c6d58dc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:30.828706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7dcb-bec1-4e48-9299-fb9f9c6d58dc None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:30.830035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 607/1167] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:30.835280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664ae9-bf4a-4886-8a12-b1a1c15d6831 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:30.835681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664ae9-bf4a-4886-8a12-b1a1c15d6831 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:30.835845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664ae9-bf4a-4886-8a12-b1a1c15d6831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:30.854279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-28664ae9-bf4a-4886-8a12-b1a1c15d6831 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:30.855475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-28664ae9-bf4a-4886-8a12-b1a1c15d6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:30.858308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:30.923840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 561/1168] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:31.192485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7dcb-bec1-4e48-9299-fb9f9c6d58dc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:31.291753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e7dcb-bec1-4e48-9299-fb9f9c6d58dc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:31.323980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef20d6-3dae-4e9a-92e0-822863965ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:31.324578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef20d6-3dae-4e9a-92e0-822863965ce6 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:31.324858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef20d6-3dae-4e9a-92e0-822863965ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:31.325131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef20d6-3dae-4e9a-92e0-822863965ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:31.325825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef20d6-3dae-4e9a-92e0-822863965ce6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:31.327189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef20d6-3dae-4e9a-92e0-822863965ce6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:31.331701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:31.345262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 608/1169] 10.222.0.30 () {60 vars in 1138 bytes} [Tue Oct 4 12:37:31 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:37:33.529103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9caffe-e1e7-4956-b7fa-d38e2401a869 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:33.529696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9caffe-e1e7-4956-b7fa-d38e2401a869 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:33.529696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9caffe-e1e7-4956-b7fa-d38e2401a869 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:33.531081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 562/1170] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:33.536813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac5f5-499a-4452-b73d-a5a2d9cbbffb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:33.537196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac5f5-499a-4452-b73d-a5a2d9cbbffb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:33.537370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac5f5-499a-4452-b73d-a5a2d9cbbffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:33.555286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-507ac5f5-499a-4452-b73d-a5a2d9cbbffb None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:33.556475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-507ac5f5-499a-4452-b73d-a5a2d9cbbffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:33.622924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 609/1171] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:33.898611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9caffe-e1e7-4956-b7fa-d38e2401a869 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:33.999912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9caffe-e1e7-4956-b7fa-d38e2401a869 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:34.035120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7da3c0-1452-4ecb-bb35-80bccf984188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:34.035746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7da3c0-1452-4ecb-bb35-80bccf984188 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:34.036020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7da3c0-1452-4ecb-bb35-80bccf984188 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:34.036287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7da3c0-1452-4ecb-bb35-80bccf984188 None admin] PATH_INFO: `/v3/domains/adc081f91ca94959989db7a5941da2aa` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:34.044201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:34.046873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7da3c0-1452-4ecb-bb35-80bccf984188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=adc081f91ca94959989db7a5941da2aa)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:34.048689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7da3c0-1452-4ecb-bb35-80bccf984188 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:34.050292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 563/1172] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Oct 4 12:37:33 2022] GET /identity/v3/domains/adc081f91ca94959989db7a5941da2aa => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:34.056054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac5f5-499a-4452-b73d-a5a2d9cbbffb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:34.150328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac5f5-499a-4452-b73d-a5a2d9cbbffb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:34.172852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:34.183879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d79ada-ac52-4b48-8b1a-036235e0447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:34.184479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79ada-ac52-4b48-8b1a-036235e0447b None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:34.184755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79ada-ac52-4b48-8b1a-036235e0447b None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:34.185023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d79ada-ac52-4b48-8b1a-036235e0447b None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:34.185691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d79ada-ac52-4b48-8b1a-036235e0447b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:34.187153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d79ada-ac52-4b48-8b1a-036235e0447b None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:34.213428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 610/1173] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:37:34 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:37:36.382990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241038-3501-4c0e-a621-6d94dabf31b2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:36.383593 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241038-3501-4c0e-a621-6d94dabf31b2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:36.383593 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241038-3501-4c0e-a621-6d94dabf31b2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:36.384897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 564/1174] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:36.391102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57965b5d-1bc4-49e3-8299-a57795fd47e3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:36.391633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57965b5d-1bc4-49e3-8299-a57795fd47e3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:36.391904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57965b5d-1bc4-49e3-8299-a57795fd47e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:36.411911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-57965b5d-1bc4-49e3-8299-a57795fd47e3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:36.413157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-57965b5d-1bc4-49e3-8299-a57795fd47e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:36.485494 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 611/1175] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:36.754496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1241038-3501-4c0e-a621-6d94dabf31b2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:36.853335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1241038-3501-4c0e-a621-6d94dabf31b2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:36.886961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140df94-22b6-4f20-b8ac-f8ea1e68dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:36.887740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140df94-22b6-4f20-b8ac-f8ea1e68dd16 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:36.888079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140df94-22b6-4f20-b8ac-f8ea1e68dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:36.888427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140df94-22b6-4f20-b8ac-f8ea1e68dd16 None admin] PATH_INFO: `/v3/domains/adc081f91ca94959989db7a5941da2aa` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:36.889766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140df94-22b6-4f20-b8ac-f8ea1e68dd16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=adc081f91ca94959989db7a5941da2aa)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:36.891402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140df94-22b6-4f20-b8ac-f8ea1e68dd16 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:36.893018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 565/1176] 10.222.0.30 () {56 vars in 1183 bytes} [Tue Oct 4 12:37:36 2022] GET /identity/v3/domains/adc081f91ca94959989db7a5941da2aa => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:36.899013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57965b5d-1bc4-49e3-8299-a57795fd47e3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:36.994928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57965b5d-1bc4-49e3-8299-a57795fd47e3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:37.001918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:37.029381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322df08d-5cc9-4798-90a6-3c730859cbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:37.029927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df08d-5cc9-4798-90a6-3c730859cbe2 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:37.030206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df08d-5cc9-4798-90a6-3c730859cbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:37.030477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322df08d-5cc9-4798-90a6-3c730859cbe2 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:37.031732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322df08d-5cc9-4798-90a6-3c730859cbe2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:37.033155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322df08d-5cc9-4798-90a6-3c730859cbe2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:37.054762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 612/1177] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:37:36 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:37:39.255312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1720-a596-4a5d-a605-1c1918a3875c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:39.255888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1720-a596-4a5d-a605-1c1918a3875c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:39.255888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1720-a596-4a5d-a605-1c1918a3875c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:39.257186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 566/1178] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:39.262620 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f507-c342-40b9-af5f-2f690a2b6457 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:39.263105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f507-c342-40b9-af5f-2f690a2b6457 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:39.263195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f507-c342-40b9-af5f-2f690a2b6457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:39.281301 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-45a4f507-c342-40b9-af5f-2f690a2b6457 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:39.282548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-45a4f507-c342-40b9-af5f-2f690a2b6457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:39.348551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 613/1179] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:37:39.615704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1720-a596-4a5d-a605-1c1918a3875c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:39.683771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:39.718964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1720-a596-4a5d-a605-1c1918a3875c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:39.752541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116bed-458d-4d6b-8e48-d9354993b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:39.753162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116bed-458d-4d6b-8e48-d9354993b93d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:39.753437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116bed-458d-4d6b-8e48-d9354993b93d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:39.753736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba116bed-458d-4d6b-8e48-d9354993b93d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:39.763726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba116bed-458d-4d6b-8e48-d9354993b93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ba116bed-458d-4d6b-8e48-d9354993b93d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:37:39.768998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:37:39.770110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:37:39.770972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 567/1180] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:37:39.776191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4f507-c342-40b9-af5f-2f690a2b6457 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:39.867463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:39.876841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4f507-c342-40b9-af5f-2f690a2b6457 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:39.910989 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:39.911591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:39.911870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:39.912139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:39.912799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:39.913106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:39.914490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:39.922715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 614/1181] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:39.929022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116bed-458d-4d6b-8e48-d9354993b93d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:40.037392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba116bed-458d-4d6b-8e48-d9354993b93d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:40.065367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:40.074034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97d32a-4078-4594-8643-1da1e0e8231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:40.074682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d32a-4078-4594-8643-1da1e0e8231d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:40.074963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d32a-4078-4594-8643-1da1e0e8231d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:40.075241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97d32a-4078-4594-8643-1da1e0e8231d None admin] PATH_INFO: `/v3/users/eb4fd0893e51420a9d1d7d2005812dab` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:40.090131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97d32a-4078-4594-8643-1da1e0e8231d None admin] RBAC: Authorizing `identity:get_user(user_id=eb4fd0893e51420a9d1d7d2005812dab)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:40.091658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97d32a-4078-4594-8643-1da1e0e8231d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:40.093577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 568/1182] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:39 2022] GET /identity/v3/users/eb4fd0893e51420a9d1d7d2005812dab => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:40.099570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:40.201507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19086efe-9a06-45c2-b7c7-aab79e580c87 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:40.234023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b435078-4740-4d14-922a-d2ce8a1bd4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:40.234623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b435078-4740-4d14-922a-d2ce8a1bd4b5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:40.234918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b435078-4740-4d14-922a-d2ce8a1bd4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:40.235174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b435078-4740-4d14-922a-d2ce8a1bd4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:40.258490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:40.303422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b435078-4740-4d14-922a-d2ce8a1bd4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:40.304884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b435078-4740-4d14-922a-d2ce8a1bd4b5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:40.401903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 615/1183] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:37:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:37:40.407974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97d32a-4078-4594-8643-1da1e0e8231d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:40.506897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97d32a-4078-4594-8643-1da1e0e8231d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:40.540504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eba527-fd6f-40b5-bcf4-d40aa32dca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:40.541130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eba527-fd6f-40b5-bcf4-d40aa32dca1f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:40.541410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eba527-fd6f-40b5-bcf4-d40aa32dca1f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:40.541709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eba527-fd6f-40b5-bcf4-d40aa32dca1f None admin] PATH_INFO: `/v3/projects/982ce4afd96d41069e1fb393e23f6712` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:40.542819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eba527-fd6f-40b5-bcf4-d40aa32dca1f None admin] RBAC: Authorizing `identity:get_project(project_id=982ce4afd96d41069e1fb393e23f6712)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:40.544247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eba527-fd6f-40b5-bcf4-d40aa32dca1f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:40.545902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 569/1184] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:40 2022] GET /identity/v3/projects/982ce4afd96d41069e1fb393e23f6712 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:40.552762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b435078-4740-4d14-922a-d2ce8a1bd4b5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:40.604579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:40.648223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b435078-4740-4d14-922a-d2ce8a1bd4b5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:40.681294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b356b-3b51-440b-bc12-af30b5f91628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:40.681936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b356b-3b51-440b-bc12-af30b5f91628 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:40.682218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b356b-3b51-440b-bc12-af30b5f91628 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:40.682490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b356b-3b51-440b-bc12-af30b5f91628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:40.683216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b356b-3b51-440b-bc12-af30b5f91628 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=982ce4afd96d41069e1fb393e23f6712, user.id=eb4fd0893e51420a9d1d7d2005812dab) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:40.683524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b356b-3b51-440b-bc12-af30b5f91628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:40.684947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b356b-3b51-440b-bc12-af30b5f91628 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:40.690873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 616/1185] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:37:40 2022] GET /identity/v3/role_assignments?user.id=eb4fd0893e51420a9d1d7d2005812dab&scope.project.id=982ce4afd96d41069e1fb393e23f6712&role.id=b8bf66974c0448089a192ead432a35f2 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:42.801672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d91f-b9de-42aa-81ce-d81b4dd92578 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:42.802177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d91f-b9de-42aa-81ce-d81b4dd92578 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:42.802266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327d91f-b9de-42aa-81ce-d81b4dd92578 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:42.803717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 570/1186] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:42.809457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00243-7673-44c2-a49c-93f6920917af None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:42.809887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00243-7673-44c2-a49c-93f6920917af None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:42.810054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c00243-7673-44c2-a49c-93f6920917af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:42.828559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-33c00243-7673-44c2-a49c-93f6920917af None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:42.829796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-33c00243-7673-44c2-a49c-93f6920917af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:42.894467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 617/1187] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:43.162707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d91f-b9de-42aa-81ce-d81b4dd92578 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:43.221544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:43.272682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327d91f-b9de-42aa-81ce-d81b4dd92578 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:43.306889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adadb2-955b-4858-80f7-9b722d3e1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:43.307513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adadb2-955b-4858-80f7-9b722d3e1cce None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:43.307796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adadb2-955b-4858-80f7-9b722d3e1cce None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:43.308066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adadb2-955b-4858-80f7-9b722d3e1cce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:43.318532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adadb2-955b-4858-80f7-9b722d3e1cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-b1adadb2-955b-4858-80f7-9b722d3e1cce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:37:43.323223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:37:43.324407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:37:43.325246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 571/1188] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:37:43.331037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c00243-7673-44c2-a49c-93f6920917af None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:43.377854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:43.428495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c00243-7673-44c2-a49c-93f6920917af None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:43.463148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:43.463781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:43.464061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:43.464331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:43.464994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:43.465297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:43.466695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:43.475088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 618/1189] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:37:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:43.480956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adadb2-955b-4858-80f7-9b722d3e1cce None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:43.579682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adadb2-955b-4858-80f7-9b722d3e1cce None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:43.593988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:43.613804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683d9b-7f34-4d57-b1ae-320cc6424547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:43.614439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683d9b-7f34-4d57-b1ae-320cc6424547 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:43.614721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683d9b-7f34-4d57-b1ae-320cc6424547 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:43.614998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683d9b-7f34-4d57-b1ae-320cc6424547 None admin] PATH_INFO: `/v3/users/eb4fd0893e51420a9d1d7d2005812dab` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:43.616118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41683d9b-7f34-4d57-b1ae-320cc6424547 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4fd0893e51420a9d1d7d2005812dab)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:43.617552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41683d9b-7f34-4d57-b1ae-320cc6424547 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:43.619173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 572/1190] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:43 2022] GET /identity/v3/users/eb4fd0893e51420a9d1d7d2005812dab => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:43.624994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:43.721091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21754c0f-20fa-4c26-b771-8d3e036924c6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:43.731045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:43.754170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0427-ca38-46c6-9481-322aded6cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:43.754794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0427-ca38-46c6-9481-322aded6cec0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:43.755070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0427-ca38-46c6-9481-322aded6cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:43.755338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0427-ca38-46c6-9481-322aded6cec0 None admin] PATH_INFO: `/v3/projects/982ce4afd96d41069e1fb393e23f6712` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:43.756436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0427-ca38-46c6-9481-322aded6cec0 None admin] RBAC: Authorizing `identity:get_project(project_id=982ce4afd96d41069e1fb393e23f6712)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:43.757884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0427-ca38-46c6-9481-322aded6cec0 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:43.759518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 619/1191] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:43 2022] GET /identity/v3/projects/982ce4afd96d41069e1fb393e23f6712 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:43.766224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683d9b-7f34-4d57-b1ae-320cc6424547 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:43.864571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683d9b-7f34-4d57-b1ae-320cc6424547 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:43.898747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87ef9-dfbd-4dc9-b030-4bd9755fb67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:43.899404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87ef9-dfbd-4dc9-b030-4bd9755fb67f None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:43.899684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87ef9-dfbd-4dc9-b030-4bd9755fb67f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:43.899958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87ef9-dfbd-4dc9-b030-4bd9755fb67f None admin] PATH_INFO: `/v3/projects/982ce4afd96d41069e1fb393e23f6712/users/eb4fd0893e51420a9d1d7d2005812dab/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:43.902121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e87ef9-dfbd-4dc9-b030-4bd9755fb67f None admin] RBAC: Authorizing `identity:create_grant(project_id=982ce4afd96d41069e1fb393e23f6712, user_id=eb4fd0893e51420a9d1d7d2005812dab, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:43.903558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e87ef9-dfbd-4dc9-b030-4bd9755fb67f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:43.915987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 573/1192] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:37:43 2022] PUT /identity/v3/projects/982ce4afd96d41069e1fb393e23f6712/users/eb4fd0893e51420a9d1d7d2005812dab/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:37:46.059731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc65c20-e25b-4d6d-9390-b0547ecfa58a None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:46.060307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc65c20-e25b-4d6d-9390-b0547ecfa58a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:46.060466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc65c20-e25b-4d6d-9390-b0547ecfa58a None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:46.062524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 620/1193] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:37:46.067947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ab70-58e1-40f6-9e34-5d3ff81b1d33 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:46.068379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ab70-58e1-40f6-9e34-5d3ff81b1d33 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:46.068486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ab70-58e1-40f6-9e34-5d3ff81b1d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:46.087188 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2737ab70-58e1-40f6-9e34-5d3ff81b1d33 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:37:46.088384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2737ab70-58e1-40f6-9e34-5d3ff81b1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:37:46.122446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:46.155001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 574/1194] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:37:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:37:46.432021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc65c20-e25b-4d6d-9390-b0547ecfa58a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:46.534883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc65c20-e25b-4d6d-9390-b0547ecfa58a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:46.568385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74076-60ed-4087-9918-032223eeedc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:46.569010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74076-60ed-4087-9918-032223eeedc0 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:46.569292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74076-60ed-4087-9918-032223eeedc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:46.569567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74076-60ed-4087-9918-032223eeedc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:46.579428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74076-60ed-4087-9918-032223eeedc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d2c74076-60ed-4087-9918-032223eeedc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:37:46.584197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:37:46.585285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:37:46.586526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 621/1195] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:37:46.591347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ab70-58e1-40f6-9e34-5d3ff81b1d33 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:46.690143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ab70-58e1-40f6-9e34-5d3ff81b1d33 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:46.722692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:46.723294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:46.723579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:46.723855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:46.724514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:46.724821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:46.726229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:46.734650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 575/1196] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:46.740606 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74076-60ed-4087-9918-032223eeedc0 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:46.781563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:46.838972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74076-60ed-4087-9918-032223eeedc0 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:46.872278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945f3dc-c813-4b81-b07c-d97d87cf58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:46.872908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945f3dc-c813-4b81-b07c-d97d87cf58f2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:46.873194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945f3dc-c813-4b81-b07c-d97d87cf58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:46.873463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945f3dc-c813-4b81-b07c-d97d87cf58f2 None admin] PATH_INFO: `/v3/users/eb4fd0893e51420a9d1d7d2005812dab` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:46.874625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945f3dc-c813-4b81-b07c-d97d87cf58f2 None admin] RBAC: Authorizing `identity:get_user(user_id=eb4fd0893e51420a9d1d7d2005812dab)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:46.876056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945f3dc-c813-4b81-b07c-d97d87cf58f2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:46.877650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 622/1197] 10.222.0.30 () {56 vars in 1177 bytes} [Tue Oct 4 12:37:46 2022] GET /identity/v3/users/eb4fd0893e51420a9d1d7d2005812dab => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:46.883480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:46.918590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:46.983669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd223-20d0-444a-99fe-cf08fa6399cb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:47.016382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2271-0ccf-42b7-b625-6d346057c57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:47.016989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2271-0ccf-42b7-b625-6d346057c57d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:47.017272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2271-0ccf-42b7-b625-6d346057c57d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:47.017547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2271-0ccf-42b7-b625-6d346057c57d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:47.082723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe2271-0ccf-42b7-b625-6d346057c57d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:47.084173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe2271-0ccf-42b7-b625-6d346057c57d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:47.116229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:47.180473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 576/1198] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:37:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:37:47.186410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945f3dc-c813-4b81-b07c-d97d87cf58f2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:47.286210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945f3dc-c813-4b81-b07c-d97d87cf58f2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:47.293438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:47.319412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090e43e-4a42-4228-8f44-5fed17366296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:47.320041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e43e-4a42-4228-8f44-5fed17366296 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:47.320321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e43e-4a42-4228-8f44-5fed17366296 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:47.320594 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e43e-4a42-4228-8f44-5fed17366296 None admin] PATH_INFO: `/v3/projects/982ce4afd96d41069e1fb393e23f6712` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:47.321727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090e43e-4a42-4228-8f44-5fed17366296 None admin] RBAC: Authorizing `identity:get_project(project_id=982ce4afd96d41069e1fb393e23f6712)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:47.323161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090e43e-4a42-4228-8f44-5fed17366296 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:47.324785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 623/1199] 10.222.0.30 () {56 vars in 1186 bytes} [Tue Oct 4 12:37:47 2022] GET /identity/v3/projects/982ce4afd96d41069e1fb393e23f6712 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:47.331729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2271-0ccf-42b7-b625-6d346057c57d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:37:47.430169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2271-0ccf-42b7-b625-6d346057c57d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:37:47.463475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09419d18-9631-4870-9886-eee69c4b10b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:37:47.464075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419d18-9631-4870-9886-eee69c4b10b0 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:37:47.464355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419d18-9631-4870-9886-eee69c4b10b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:37:47.464628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09419d18-9631-4870-9886-eee69c4b10b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:37:47.465347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09419d18-9631-4870-9886-eee69c4b10b0 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=982ce4afd96d41069e1fb393e23f6712, user.id=eb4fd0893e51420a9d1d7d2005812dab) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:37:47.465688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09419d18-9631-4870-9886-eee69c4b10b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:37:47.467120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09419d18-9631-4870-9886-eee69c4b10b0 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:37:47.469490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:47.474318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 577/1200] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:37:47 2022] GET /identity/v3/role_assignments?user.id=eb4fd0893e51420a9d1d7d2005812dab&scope.project.id=982ce4afd96d41069e1fb393e23f6712&role.id=b8bf66974c0448089a192ead432a35f2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:37:57.315215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=13 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:37:57.474700 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:44.220252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87350d0-d3f3-45c8-b116-97a6e57006c5 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:44.220843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87350d0-d3f3-45c8-b116-97a6e57006c5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:44.220843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87350d0-d3f3-45c8-b116-97a6e57006c5 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:44.222188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 624/1201] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:38:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:38:44.228114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb546f-e671-402a-b1a4-09fe3746c861 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:44.228689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb546f-e671-402a-b1a4-09fe3746c861 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:44.228689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb546f-e671-402a-b1a4-09fe3746c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:44.247841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8dbb546f-e671-402a-b1a4-09fe3746c861 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:38:44.249671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8dbb546f-e671-402a-b1a4-09fe3746c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:38:44.334573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 578/1202] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:38:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:38:44.627269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87350d0-d3f3-45c8-b116-97a6e57006c5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:44.735555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87350d0-d3f3-45c8-b116-97a6e57006c5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:44.786965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:44.787693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:44.788078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:44.788352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:44.799957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:44.801556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:38:44.824207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:44.825379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:38:44.826382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:38:44.826382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:44.826382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:38:44.826382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 625/1203] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:44.832649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb546f-e671-402a-b1a4-09fe3746c861 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:44.969857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb546f-e671-402a-b1a4-09fe3746c861 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:45.005855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:45.013103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0866-7532-474c-9663-a921941a5f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:45.018540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0866-7532-474c-9663-a921941a5f03 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:45.018849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0866-7532-474c-9663-a921941a5f03 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:45.019155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0866-7532-474c-9663-a921941a5f03 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:45.019903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c0866-7532-474c-9663-a921941a5f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:45.020630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c0866-7532-474c-9663-a921941a5f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:45.022177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c0866-7532-474c-9663-a921941a5f03 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:45.036258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 579/1204] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:45.042838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:45.111574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:45.171183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ee4c6-1c8d-462a-9a63-544317cf9eb2 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:45.216115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd38c09-bb30-4d81-a3a7-9145e08326e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:45.217005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd38c09-bb30-4d81-a3a7-9145e08326e2 None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:45.217460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd38c09-bb30-4d81-a3a7-9145e08326e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:45.217989 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd38c09-bb30-4d81-a3a7-9145e08326e2 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:45.218653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd38c09-bb30-4d81-a3a7-9145e08326e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:45.220226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd38c09-bb30-4d81-a3a7-9145e08326e2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:45.244076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 626/1205] 10.222.0.30 () {60 vars in 1132 bytes} [Tue Oct 4 12:38:45 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:38:47.613489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b39c-3368-466c-84ab-24f506c520a0 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:47.614086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b39c-3368-466c-84ab-24f506c520a0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:47.614086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b39c-3368-466c-84ab-24f506c520a0 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:47.615421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 580/1206] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:38:47.620990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81980c-b628-47d8-8d8e-9d859073543b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:47.621502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81980c-b628-47d8-8d8e-9d859073543b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:47.621587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81980c-b628-47d8-8d8e-9d859073543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:47.640441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ce81980c-b628-47d8-8d8e-9d859073543b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:38:47.641663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ce81980c-b628-47d8-8d8e-9d859073543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:38:47.716104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 627/1207] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:38:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:38:47.985079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b39c-3368-466c-84ab-24f506c520a0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:48.112027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b39c-3368-466c-84ab-24f506c520a0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:48.153359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756281ab-0f19-4795-8732-a4bb6b207709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:48.154061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756281ab-0f19-4795-8732-a4bb6b207709 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:48.154357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756281ab-0f19-4795-8732-a4bb6b207709 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:48.154660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756281ab-0f19-4795-8732-a4bb6b207709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:48.165391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756281ab-0f19-4795-8732-a4bb6b207709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-756281ab-0f19-4795-8732-a4bb6b207709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:38:48.170797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:48.173045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:38:48.174053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 581/1208] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:38:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:48.178491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81980c-b628-47d8-8d8e-9d859073543b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:48.235881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:48.316916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81980c-b628-47d8-8d8e-9d859073543b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:48.356395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:48.357046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:48.357359 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:48.357702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:48.358971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:48.359282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:48.360832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:48.370483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 628/1209] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:38:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:48.376182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756281ab-0f19-4795-8732-a4bb6b207709 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:48.444336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:48.507031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756281ab-0f19-4795-8732-a4bb6b207709 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:48.549101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:48.549825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:48.550185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:48.550381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:48.563476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:48.565020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:38:48.582704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:48.583898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:38:48.584905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:38:48.584905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:48.584905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:38:48.589647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 582/1210] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:48.590060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:48.785034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:48.790101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415780f-7e67-4cff-b496-1be67b84a854 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:48.864263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:48.865419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:48.866015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:48.867666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:48.868002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:48.868545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:48.871485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:48.901685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 629/1211] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:48.904143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:49.032573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd1602-2a19-450b-ad7a-73792ed9e792 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:49.034798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:49.072497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:49.072972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:49.073282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:49.073517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:49.082347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:49.086049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:38:49.098439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:49.104658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:38:49.105807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 583/1212] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:38:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:49.106555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:49.222357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f882-f296-45af-945d-511f4a8fb994 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:49.267561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:49.267561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:49.267561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:49.267561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:49.268187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:49.268272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:49.269760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:49.294082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 630/1213] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 4 12:38:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:49.299906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:49.431215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42cb22-f207-42eb-a78a-1b77a3e00a6d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:49.468582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6fc9-3593-495d-b6e0-564e878daffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:49.469456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6fc9-3593-495d-b6e0-564e878daffa None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:49.469906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6fc9-3593-495d-b6e0-564e878daffa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:49.470340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e6fc9-3593-495d-b6e0-564e878daffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:49.503092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:49.549641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6fc9-3593-495d-b6e0-564e878daffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:49.551381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e6fc9-3593-495d-b6e0-564e878daffa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:49.656390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 584/1214] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:38:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 12:38:49.662456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:49.685785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:49.787196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da4f8-a7c1-4ee8-a86c-1a482ce81c3a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:49.833181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:49.833955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:49.834238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:49.834513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:49.847889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:49.849354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:38:49.867041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:49.868320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:38:49.869217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:38:49.869217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:49.869217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:38:49.869217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 631/1215] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:49.876592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6fc9-3593-495d-b6e0-564e878daffa None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:49.954861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:50.013016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e6fc9-3593-495d-b6e0-564e878daffa None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:50.054680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:50.055468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:50.055865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:50.056257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:50.057031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:50.057441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:50.059015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:50.072390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 585/1216] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:50.077963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:50.166065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:50.203792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f16ef1-0ab2-4232-bf6b-60efde9f05ad None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:50.246955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:50.247688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:50.248380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:50.248380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:50.259786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:50.261294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:38:50.274280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:50.275455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:50.276941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:38:50.276941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:38:50.276941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:38:50.276941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:38:50.276941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:38:50.276941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:38:50.276941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:38:50.276941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:38:50.282413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 632/1217] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:38:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:50.283561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:50.452438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde783db-93c9-4797-851f-cc381067ba1f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:50.488622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:50.501667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8343f25-c8e5-4b13-a152-508680c0c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:50.502372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343f25-c8e5-4b13-a152-508680c0c312 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:50.502682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343f25-c8e5-4b13-a152-508680c0c312 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:50.502929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8343f25-c8e5-4b13-a152-508680c0c312 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:50.503902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343f25-c8e5-4b13-a152-508680c0c312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:50.504211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343f25-c8e5-4b13-a152-508680c0c312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:50.505955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8343f25-c8e5-4b13-a152-508680c0c312 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:50.532672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 586/1218] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:38:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:38:50.539727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:50.658341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe193a72-c547-402f-8256-a8c7ea040eff None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:50.690530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:50.697017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8efdd-a599-47b9-989a-ad4b1eb17e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:50.697721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8efdd-a599-47b9-989a-ad4b1eb17e78 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:50.698000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8efdd-a599-47b9-989a-ad4b1eb17e78 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:50.698269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8efdd-a599-47b9-989a-ad4b1eb17e78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:50.698990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8efdd-a599-47b9-989a-ad4b1eb17e78 None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=2243f5d37f1443e1a3d6fc7a8eadb46c) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:50.699295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8efdd-a599-47b9-989a-ad4b1eb17e78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:50.700721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8efdd-a599-47b9-989a-ad4b1eb17e78 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:50.707572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 633/1219] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:38:50 2022] GET /identity/v3/role_assignments?user.id=2243f5d37f1443e1a3d6fc7a8eadb46c&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:53.051139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb5a0-0347-40d2-a594-87e35a9124e5 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:53.051754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb5a0-0347-40d2-a594-87e35a9124e5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:53.052076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb5a0-0347-40d2-a594-87e35a9124e5 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:53.054496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 587/1220] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:38:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:38:53.060265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb31b-895e-4899-8045-5a59db1dae2c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:53.060809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb31b-895e-4899-8045-5a59db1dae2c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:53.060809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb31b-895e-4899-8045-5a59db1dae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:53.086275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-01afb31b-895e-4899-8045-5a59db1dae2c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:38:53.087751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-01afb31b-895e-4899-8045-5a59db1dae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:38:53.177287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 634/1221] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:38:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:38:53.464247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beb5a0-0347-40d2-a594-87e35a9124e5 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:53.585503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beb5a0-0347-40d2-a594-87e35a9124e5 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:53.636270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa41e0-1486-4a68-b252-06062a8d3297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:53.637731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa41e0-1486-4a68-b252-06062a8d3297 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:53.638211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa41e0-1486-4a68-b252-06062a8d3297 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:53.638689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa41e0-1486-4a68-b252-06062a8d3297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:53.655290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa41e0-1486-4a68-b252-06062a8d3297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-5aaa41e0-1486-4a68-b252-06062a8d3297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:38:53.660749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:53.661981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:38:53.662864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 588/1222] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:38:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:38:53.669516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afb31b-895e-4899-8045-5a59db1dae2c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:53.803542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afb31b-895e-4899-8045-5a59db1dae2c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:53.838262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:53.860793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:53.862015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:53.862533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:53.863062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:53.864356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] RBAC: Adding query filter params (name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:53.864991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:53.867840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:53.884736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 635/1223] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:38:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:53.891051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa41e0-1486-4a68-b252-06062a8d3297 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:53.946559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:54.028662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa41e0-1486-4a68-b252-06062a8d3297 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:54.079912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:54.081025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:54.081352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:54.081837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:54.098726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:54.101231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:38:54.133218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:54.135408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:38:54.137427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:38:54.137427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:54.137427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:38:54.140594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 589/1224] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:38:54.151199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:54.324010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea752fe-6144-4d1a-8021-9312589fbd15 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:54.392820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:54.393943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:54.394447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:54.394935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:54.396151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:54.396710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:54.399454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:54.422725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 636/1225] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:54.432876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:54.591249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:54.604181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129974f-1f82-4088-8ab1-aa5d2d651eaf None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:54.675403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:54.676481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:54.676902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:54.677361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:54.691107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:54.692982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:38:54.709230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:54.711478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:38:54.713047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 590/1226] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:38:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:54.720134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:54.784284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:54.862981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a340d-64de-4031-960c-4383dcdccc5a None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:54.919550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:54.920604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:54.921084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:54.921564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:54.922944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:54.923487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:54.926183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:54.953197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 637/1227] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 4 12:38:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:38:54.960125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:55.127803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2203204-3894-4c21-aaf2-6194be588bdb None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:55.180505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:55.181818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:55.182366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:55.182856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:55.205616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:55.207272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:38:55.222863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:55.224798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:38:55.226620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:38:55.226620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:55.226620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:38:55.226620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 591/1228] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:55.230390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:55.381352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca5af6-33ee-4362-9267-1082e7e41c37 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:55.384191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:55.435063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:55.436640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:55.437016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:55.437290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:55.438054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:55.438391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:55.439933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:55.454765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 638/1229] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:38:55.463490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:55.475615 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:55.598918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7f04f-5240-41fb-a64e-566925922cd2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:55.648069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:55.648812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:55.649247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:55.649647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:55.664575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:55.667599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:38:55.688779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:55.690682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:38:55.692032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 592/1230] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:38:55.698961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:55.848943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde93849-4cbc-4961-8660-f705d4e606bc None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:55.889868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21311c79-e315-4637-b6ed-93a24b43ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:55.890692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311c79-e315-4637-b6ed-93a24b43ce89 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:55.891093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311c79-e315-4637-b6ed-93a24b43ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:55.891497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311c79-e315-4637-b6ed-93a24b43ce89 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:55.892332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21311c79-e315-4637-b6ed-93a24b43ce89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:55.892769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21311c79-e315-4637-b6ed-93a24b43ce89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:55.894424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21311c79-e315-4637-b6ed-93a24b43ce89 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:55.918498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 639/1231] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:55.919676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:56.032274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:56.081009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb560cbf-c603-482e-9297-4798ed8a474f None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:56.120985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b34c1-2814-4311-a9a9-b2e54ecea968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:56.121675 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b34c1-2814-4311-a9a9-b2e54ecea968 None admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:56.121972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b34c1-2814-4311-a9a9-b2e54ecea968 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:56.122252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b34c1-2814-4311-a9a9-b2e54ecea968 None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/2243f5d37f1443e1a3d6fc7a8eadb46c/roles/361ada32137e4db3aa12e6776e5789d7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:56.142310 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b34c1-2814-4311-a9a9-b2e54ecea968 None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=2243f5d37f1443e1a3d6fc7a8eadb46c, role_id=361ada32137e4db3aa12e6776e5789d7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:56.144421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b34c1-2814-4311-a9a9-b2e54ecea968 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:56.161569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 593/1232] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:38:55 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/2243f5d37f1443e1a3d6fc7a8eadb46c/roles/361ada32137e4db3aa12e6776e5789d7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:38:58.568438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc69f-c511-422f-adfe-d7cd9c18dae2 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:58.569011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc69f-c511-422f-adfe-d7cd9c18dae2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:58.569011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc69f-c511-422f-adfe-d7cd9c18dae2 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:58.570603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 640/1233] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:38:58.576591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ce2c-88a1-422c-9244-61a1f5b97054 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:58.577165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ce2c-88a1-422c-9244-61a1f5b97054 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:58.577165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ce2c-88a1-422c-9244-61a1f5b97054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:58.598125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4440ce2c-88a1-422c-9244-61a1f5b97054 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:38:58.599437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4440ce2c-88a1-422c-9244-61a1f5b97054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:38:58.721243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 594/1234] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:38:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:38:59.005149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc69f-c511-422f-adfe-d7cd9c18dae2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:59.056613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:59.184023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc69f-c511-422f-adfe-d7cd9c18dae2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:59.244300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1144c-fad6-4d66-9e04-7bcc2f60eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:59.245312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1144c-fad6-4d66-9e04-7bcc2f60eb9d None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:59.245976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1144c-fad6-4d66-9e04-7bcc2f60eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:59.246487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1144c-fad6-4d66-9e04-7bcc2f60eb9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:59.264382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1144c-fad6-4d66-9e04-7bcc2f60eb9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-6bb1144c-fad6-4d66-9e04-7bcc2f60eb9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:38:59.271976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:59.278122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:38:59.279130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 641/1235] 10.222.0.30 () {56 vars in 1102 bytes} [Tue Oct 4 12:38:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:38:59.285180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ce2c-88a1-422c-9244-61a1f5b97054 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:59.370186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:59.470021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ce2c-88a1-422c-9244-61a1f5b97054 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:59.528961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:59.530026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:59.530600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:59.531131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:59.532523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] RBAC: Adding query filter params (name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:38:59.533437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:59.536073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:59.552230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 595/1236] 10.222.0.30 () {56 vars in 1103 bytes} [Tue Oct 4 12:38:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:38:59.559349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1144c-fad6-4d66-9e04-7bcc2f60eb9d None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:38:59.700983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:38:59.723011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1144c-fad6-4d66-9e04-7bcc2f60eb9d None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:38:59.772353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:38:59.773038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:38:59.773449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:38:59.773826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:38:59.786691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:38:59.788324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:38:59.811534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:38:59.813788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:38:59.815923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:38:59.815923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:38:59.815923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:38:59.815923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 642/1237] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:38:59.822950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:00.010103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4c8b-d1d7-454d-9834-f24473d87726 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:00.031599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:00.079397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:00.080756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:00.081360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:00.082016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:00.083378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:00.084233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:00.088338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:00.112872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 596/1238] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:00.120046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:00.264158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a51c1-fc42-4b9a-bee4-ec9509bd02aa None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:00.309587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:00.310275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:00.310557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:00.311390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] PATH_INFO: `/v3/users/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:00.315426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:00.322953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:00.324502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:39:00.339643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:00.340819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:00.341790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 643/1239] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:39:00.350993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:00.492181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c393fcd-b245-450a-b740-9eef9abee158 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:00.543907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:00.544761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:00.545080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:00.545405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:00.546288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:00.546595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:00.548268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:00.591017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 597/1240] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 4 12:39:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:00.606449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:00.747512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6010a2a-3b61-49dc-8a24-d1d58ca5aefa None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:00.797356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a5303-4dc2-43cb-ae97-1a315f31d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:00.798004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5303-4dc2-43cb-ae97-1a315f31d221 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:00.798286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5303-4dc2-43cb-ae97-1a315f31d221 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:00.798564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5303-4dc2-43cb-ae97-1a315f31d221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:00.897155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:00.907301 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a5303-4dc2-43cb-ae97-1a315f31d221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:00.909377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a5303-4dc2-43cb-ae97-1a315f31d221 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:01.087384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 644/1241] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:39:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:39:01.097539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:01.133226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:01.254644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1fb1c-67f6-40d4-bc22-3872cbb56041 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:01.308243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:01.309335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:01.309979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:01.310371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:01.330055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:01.332438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:39:01.357361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:01.360025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:39:01.361924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:39:01.361924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:01.361924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:01.361924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 598/1242] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:01.368220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a5303-4dc2-43cb-ae97-1a315f31d221 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:01.504520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:01.512598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a5303-4dc2-43cb-ae97-1a315f31d221 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:01.560546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:01.561773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:01.562059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:01.562385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:01.563056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:01.563378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:01.564809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:01.582190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 645/1243] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:39:01.591420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:01.712797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:01.740633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca10d3b-eebb-44ee-9335-f380e7259c45 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:01.790356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:01.791292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:01.791765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:01.792251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:01.801494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:01.803010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:39:01.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:01.817252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:01.818222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 599/1244] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:01.823884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:01.983652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544403e2-c750-4d41-a9b6-471b3fb38bdd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:02.043369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b57c7-9562-4c82-9c1a-ca0d2f130948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:02.043913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b57c7-9562-4c82-9c1a-ca0d2f130948 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:02.044347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b57c7-9562-4c82-9c1a-ca0d2f130948 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:02.044563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b57c7-9562-4c82-9c1a-ca0d2f130948 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:02.045361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b57c7-9562-4c82-9c1a-ca0d2f130948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:02.045710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b57c7-9562-4c82-9c1a-ca0d2f130948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:02.049123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b57c7-9562-4c82-9c1a-ca0d2f130948 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:02.063936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 646/1245] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:02.071207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:02.235794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b673c-ffe4-4bfc-805b-04fc6355c305 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:02.309680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5f9cc-ef53-48dd-bcab-2f907ffdd5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:02.310908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f9cc-ef53-48dd-bcab-2f907ffdd5fa None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:02.311579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f9cc-ef53-48dd-bcab-2f907ffdd5fa None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:02.312317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5f9cc-ef53-48dd-bcab-2f907ffdd5fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:02.313350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5f9cc-ef53-48dd-bcab-2f907ffdd5fa None admin] RBAC: Adding query filter params (role.id=361ada32137e4db3aa12e6776e5789d7, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=2243f5d37f1443e1a3d6fc7a8eadb46c) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:02.314133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5f9cc-ef53-48dd-bcab-2f907ffdd5fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:02.316782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5f9cc-ef53-48dd-bcab-2f907ffdd5fa None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:02.327475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 600/1246] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:39:02 2022] GET /identity/v3/role_assignments?user.id=2243f5d37f1443e1a3d6fc7a8eadb46c&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=361ada32137e4db3aa12e6776e5789d7 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:05.066645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c8f5-1b89-4ef3-9756-7002ba746635 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:05.067572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c8f5-1b89-4ef3-9756-7002ba746635 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:05.067572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588c8f5-1b89-4ef3-9756-7002ba746635 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:05.069510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 647/1247] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:39:05.077864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425899c-ae28-41ec-8731-9bfbee1d8f73 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:05.078417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425899c-ae28-41ec-8731-9bfbee1d8f73 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:05.078417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425899c-ae28-41ec-8731-9bfbee1d8f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:05.085215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:05.102802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0425899c-ae28-41ec-8731-9bfbee1d8f73 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:39:05.104231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0425899c-ae28-41ec-8731-9bfbee1d8f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:39:05.209355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 601/1248] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:39:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:39:05.508872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588c8f5-1b89-4ef3-9756-7002ba746635 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:05.531706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:05.659438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588c8f5-1b89-4ef3-9756-7002ba746635 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:05.721124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c607f1f-49d2-430c-a9f1-ae398f6f4c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:05.721710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c607f1f-49d2-430c-a9f1-ae398f6f4c31 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:05.722092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c607f1f-49d2-430c-a9f1-ae398f6f4c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:05.722498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c607f1f-49d2-430c-a9f1-ae398f6f4c31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:05.737873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c607f1f-49d2-430c-a9f1-ae398f6f4c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-9c607f1f-49d2-430c-a9f1-ae398f6f4c31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:39:05.745440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:05.747685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:05.750593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 648/1249] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:05.756294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425899c-ae28-41ec-8731-9bfbee1d8f73 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:05.917229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425899c-ae28-41ec-8731-9bfbee1d8f73 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:05.957009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:05.964617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:05.965301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:05.965664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:05.965964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:05.967582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:05.968118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:05.970760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:05.984678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 602/1250] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:39:05.994115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c607f1f-49d2-430c-a9f1-ae398f6f4c31 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:06.103945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:06.128383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c607f1f-49d2-430c-a9f1-ae398f6f4c31 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:06.170780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:06.171411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:06.171684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:06.171960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:06.184718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:06.186371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:39:06.205585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:06.207363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:39:06.209298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:39:06.209298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:06.209298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:06.209298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 649/1251] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:39:06.214110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:06.355020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b2f6c-eb76-419a-b41d-1ef865ff8e89 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:06.392545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:06.393170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:06.393447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:06.393755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:06.394404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:06.394709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:06.396095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:06.411345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 603/1252] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:06.418412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:06.536530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa30fd2-0ec4-474d-95c5-4a45e4494a6e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:06.573657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:06.583998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:06.584718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:06.585099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:06.585360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:06.595981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:06.598612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:39:06.613747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:06.615826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:06.617644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 650/1253] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:06.623794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:06.716485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:06.800175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063270a5-b55d-4cb7-ad65-d3cb6b1cc142 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:06.849206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:06.850048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:06.850338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:06.850782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:06.851622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:06.852064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:06.853459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:06.875452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 604/1254] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 4 12:39:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:39:06.888725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:07.044285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e9408-8eb0-4bf0-8fde-45613ebf88d5 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:07.087449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf173831-e84e-4053-9607-b10a65a2e68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:07.088433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173831-e84e-4053-9607-b10a65a2e68c None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:07.088919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173831-e84e-4053-9607-b10a65a2e68c None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:07.089398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf173831-e84e-4053-9607-b10a65a2e68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:07.171041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:07.186063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf173831-e84e-4053-9607-b10a65a2e68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:07.187789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf173831-e84e-4053-9607-b10a65a2e68c None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:07.329278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 651/1255] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:39:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 12:39:07.335701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:07.493684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aacab5-6b7c-44c4-9238-d3ce3693d3a6 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:07.510739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:07.538616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:07.539278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:07.539556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:07.539830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:07.552854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:07.554319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:39:07.572191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:07.573481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:39:07.574875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:39:07.574875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:07.574875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:07.574875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 605/1256] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:39:07.582560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf173831-e84e-4053-9607-b10a65a2e68c None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:07.688778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:07.703105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf173831-e84e-4053-9607-b10a65a2e68c None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:07.743662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:07.744451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:07.744806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:07.745214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:07.746095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:07.746602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:07.748272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:07.764106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 652/1257] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:07.769972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:07.894461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ab572-207f-4ecd-a993-7401efc039e8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:07.936292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:07.936889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:07.937173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:07.937451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:07.945042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:07.946562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:39:07.959304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:07.960543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:07.962305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 606/1258] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:39:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:07.971743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:08.092191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371ddf8-e198-4117-afdc-7bc6d9de9d21 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:08.125464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61901a67-f132-4cfd-846f-12aec9f75350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:08.126096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901a67-f132-4cfd-846f-12aec9f75350 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:08.126377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901a67-f132-4cfd-846f-12aec9f75350 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:08.126651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901a67-f132-4cfd-846f-12aec9f75350 None admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:08.127353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61901a67-f132-4cfd-846f-12aec9f75350 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:08.127819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61901a67-f132-4cfd-846f-12aec9f75350 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:08.129098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61901a67-f132-4cfd-846f-12aec9f75350 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:08.143017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 653/1259] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:08.149414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:08.184275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:08.263546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390cf06-4854-4750-b5bf-d0881912f79e None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:08.300174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8ff9c-33cb-49fd-a691-47604e83f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:08.300781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ff9c-33cb-49fd-a691-47604e83f6e8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:08.301059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ff9c-33cb-49fd-a691-47604e83f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:08.301337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8ff9c-33cb-49fd-a691-47604e83f6e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:08.302097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8ff9c-33cb-49fd-a691-47604e83f6e8 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=2243f5d37f1443e1a3d6fc7a8eadb46c) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:08.302401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8ff9c-33cb-49fd-a691-47604e83f6e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:08.303839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8ff9c-33cb-49fd-a691-47604e83f6e8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:08.309461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 607/1260] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:39:08 2022] GET /identity/v3/role_assignments?user.id=2243f5d37f1443e1a3d6fc7a8eadb46c&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=b8bf66974c0448089a192ead432a35f2 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:10.534927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea1866-9c83-47a6-b9ab-196b7ed9cc5d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:10.535465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea1866-9c83-47a6-b9ab-196b7ed9cc5d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:10.535465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea1866-9c83-47a6-b9ab-196b7ed9cc5d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:10.536809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 654/1261] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:39:10.542901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541ffa-6648-471c-91ba-c8676fd77a36 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:10.543579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541ffa-6648-471c-91ba-c8676fd77a36 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:10.543761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541ffa-6648-471c-91ba-c8676fd77a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:10.567815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-de541ffa-6648-471c-91ba-c8676fd77a36 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:39:10.569444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-de541ffa-6648-471c-91ba-c8676fd77a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:39:10.645494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 608/1262] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:39:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:39:10.928439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea1866-9c83-47a6-b9ab-196b7ed9cc5d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:10.945484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:11.049066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea1866-9c83-47a6-b9ab-196b7ed9cc5d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:11.085288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c83501-d00b-449c-aca4-fa148cbe9ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:11.085948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c83501-d00b-449c-aca4-fa148cbe9ff4 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:11.086231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c83501-d00b-449c-aca4-fa148cbe9ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:11.086503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c83501-d00b-449c-aca4-fa148cbe9ff4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:11.101110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c83501-d00b-449c-aca4-fa148cbe9ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-54c83501-d00b-449c-aca4-fa148cbe9ff4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:39:11.105940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:11.107061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:11.108588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 655/1263] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:11.114632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541ffa-6648-471c-91ba-c8676fd77a36 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:11.133905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:11.218676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541ffa-6648-471c-91ba-c8676fd77a36 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:11.253103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:11.253752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:11.254038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:11.254316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:11.254986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:11.255296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:11.256683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:11.266371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 609/1264] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:11.273188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c83501-d00b-449c-aca4-fa148cbe9ff4 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:11.346701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:11.382347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c83501-d00b-449c-aca4-fa148cbe9ff4 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:11.421188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:11.421856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:11.422137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:11.422407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:11.433843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:11.435319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:39:11.456694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:11.458025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:39:11.459103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:39:11.459103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:11.459103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:11.459103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 656/1265] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:39:11.464379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:11.554538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:11.575388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5905b-c398-46ef-98f8-7e051c01b325 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:11.612345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:11.612957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:11.613239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:11.613513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:11.614187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:11.614492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:11.615923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:11.628600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 610/1266] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:11.635585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:11.743911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fb683-84cd-4870-ae09-cc95adcdc3eb None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:11.764575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:11.785135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:11.786238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:11.786729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:11.787217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:11.798849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:11.801115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:39:11.818478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:11.819608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:11.820759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 657/1267] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:11.825697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:11.939276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119122e3-318e-4098-965f-d7a05bc6f2ca None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:11.977203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:11.977964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:11.978252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:11.978526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:11.979383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:11.979692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:11.981380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:11.993458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:12.003242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 611/1268] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 4 12:39:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:39:12.009618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:12.116492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99350-2cf1-4ea4-9466-e85cb7fb7b6f None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:12.151760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:12.152405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:12.152682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:12.152954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:12.164543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:12.166039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:39:12.180529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:12.181762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:39:12.182750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:39:12.182750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:12.182750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:12.182750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 658/1269] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:12.187695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:12.294809 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2604e2-5f13-4de1-a5a1-a3c1bf260a93 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:12.338022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:12.338653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:12.338938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:12.339212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:12.339865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:12.340172 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:12.341564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:12.354728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 612/1270] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:12.361203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:12.395864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:12.485806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb516962-fa26-4f73-b35c-9decee6b9888 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:12.528507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:12.529199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:12.529484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:12.529789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:12.537818 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:12.539580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:39:12.552876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:12.554949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:12.556998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 659/1271] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:39:12.562176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:12.628208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:12.693260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47221e2f-0098-45c7-bc0d-788b62ebc628 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:12.754016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d59aca-a74e-41a3-b51b-e486005cbc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:12.754637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59aca-a74e-41a3-b51b-e486005cbc16 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:12.754920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59aca-a74e-41a3-b51b-e486005cbc16 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:12.755198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59aca-a74e-41a3-b51b-e486005cbc16 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:12.755906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d59aca-a74e-41a3-b51b-e486005cbc16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:12.756213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d59aca-a74e-41a3-b51b-e486005cbc16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:12.757695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d59aca-a74e-41a3-b51b-e486005cbc16 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:12.770915 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 613/1272] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:12.782785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:12.877906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:12.887293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9298-f8a8-45a6-9d21-42108c3e4ebd None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:12.923695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2f863-d9e5-4f9a-ba87-4b889af021fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:12.924434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2f863-d9e5-4f9a-ba87-4b889af021fc None admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:12.924735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2f863-d9e5-4f9a-ba87-4b889af021fc None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:12.925039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2f863-d9e5-4f9a-ba87-4b889af021fc None admin] PATH_INFO: `/v3/projects/87ddc76b49714ed489f4127ea049425b/users/2243f5d37f1443e1a3d6fc7a8eadb46c/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:12.927147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2f863-d9e5-4f9a-ba87-4b889af021fc None admin] RBAC: Authorizing `identity:create_grant(project_id=87ddc76b49714ed489f4127ea049425b, user_id=2243f5d37f1443e1a3d6fc7a8eadb46c, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:12.928883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2f863-d9e5-4f9a-ba87-4b889af021fc None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:12.942921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 660/1273] 10.222.0.30 () {58 vars in 1439 bytes} [Tue Oct 4 12:39:12 2022] PUT /identity/v3/projects/87ddc76b49714ed489f4127ea049425b/users/2243f5d37f1443e1a3d6fc7a8eadb46c/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:39:15.132999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199952-0ebd-429a-8520-1f119ba0d4ef None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:15.133547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199952-0ebd-429a-8520-1f119ba0d4ef None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:15.133547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199952-0ebd-429a-8520-1f119ba0d4ef None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:15.135060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 614/1274] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:39:15.141153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff755bc-44f1-481f-82f3-443b62d00784 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:15.141749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff755bc-44f1-481f-82f3-443b62d00784 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:15.141843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff755bc-44f1-481f-82f3-443b62d00784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:15.161739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1ff755bc-44f1-481f-82f3-443b62d00784 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:39:15.162965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1ff755bc-44f1-481f-82f3-443b62d00784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:39:15.233032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 661/1275] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:39:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:39:15.518594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199952-0ebd-429a-8520-1f119ba0d4ef None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:15.632820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199952-0ebd-429a-8520-1f119ba0d4ef None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:15.652084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:15.672102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821a63-8c3e-4de6-b9e7-dfb91b5a469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:15.672715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821a63-8c3e-4de6-b9e7-dfb91b5a469d None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:15.673078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821a63-8c3e-4de6-b9e7-dfb91b5a469d None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:15.673261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821a63-8c3e-4de6-b9e7-dfb91b5a469d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:15.684495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39821a63-8c3e-4de6-b9e7-dfb91b5a469d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-39821a63-8c3e-4de6-b9e7-dfb91b5a469d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 12:39:15.689616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:15.690711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:15.691751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 615/1276] 10.222.0.30 () {56 vars in 1096 bytes} [Tue Oct 4 12:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:15.697142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff755bc-44f1-481f-82f3-443b62d00784 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:15.786329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:15.810381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff755bc-44f1-481f-82f3-443b62d00784 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:15.848967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:15.849582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:15.849899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:15.850170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:15.850896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:15.851220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:15.852598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:15.861282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 662/1277] 10.222.0.30 () {56 vars in 1099 bytes} [Tue Oct 4 12:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:39:15.867821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821a63-8c3e-4de6-b9e7-dfb91b5a469d None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:15.986342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821a63-8c3e-4de6-b9e7-dfb91b5a469d None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:16.035507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:16.036136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:16.036406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:16.036649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:16.050241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:16.052569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:39:16.084585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:16.085870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:39:16.086973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:39:16.086973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:16.086973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:16.087361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 616/1278] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:16.093638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:16.197148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d737a-83cb-417e-80e0-5c220be9b0bb None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:16.238434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:16.238961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:16.239237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:16.239513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:16.240160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:16.240468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:16.241863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:16.254362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 663/1279] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:16.260339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:16.303021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:16.382236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d11d4-6a9e-4f7a-8bb7-4988fed95869 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:16.417428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:16.418115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:16.418395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:16.418675 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:16.430464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:16.431935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 12:39:16.443857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:16.445697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:16.447614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 617/1280] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 12:39:16.454876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:16.458848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:16.565246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9728b-b88e-4e30-8938-969669989520 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:16.608906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:16.609691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:16.610100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:16.610486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:16.611522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:16.611926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:16.614317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:16.642336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 664/1281] 10.222.0.30 () {56 vars in 1143 bytes} [Tue Oct 4 12:39:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:39:16.648484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:16.745995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:16.760401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1fe1f-aeb7-4248-88c0-b09e56d6d300 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:16.798761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379a33-bb60-4d2b-bbe3-d67693789a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:16.799398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379a33-bb60-4d2b-bbe3-d67693789a75 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:16.799681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379a33-bb60-4d2b-bbe3-d67693789a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:16.799963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379a33-bb60-4d2b-bbe3-d67693789a75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:16.871629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379a33-bb60-4d2b-bbe3-d67693789a75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:16.873734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379a33-bb60-4d2b-bbe3-d67693789a75 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:16.968422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:16.980087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 618/1282] 10.222.0.30 () {58 vars in 1282 bytes} [Tue Oct 4 12:39:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 12:39:16.988255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:17.069710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:17.110467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71526300-eff9-4295-abcf-e9a7e777e3a6 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:17.146726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:17.147269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:17.147545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:17.147816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:17.159490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:17.160955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 12:39:17.176613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:17.178543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 12:39:17.180580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 12:39:17.180580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 12:39:17.180580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:17.180580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 665/1283] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:17.189221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379a33-bb60-4d2b-bbe3-d67693789a75 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:17.294339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379a33-bb60-4d2b-bbe3-d67693789a75 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:17.331529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:17.332144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:17.332427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:17.332703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:17.333431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:17.333889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:17.335286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:17.347192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 619/1284] 10.222.0.30 () {56 vars in 1109 bytes} [Tue Oct 4 12:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:17.352892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:17.458965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255e0da-3294-45f9-b123-0e3272e7b185 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:17.474016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:17.495638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:17.496275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:17.496553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:17.496827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:17.504570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:17.506087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 12:39:17.519102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:17.520232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: ERROR keystone.server.flask.application Oct 04 12:39:17.521209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 666/1285] 10.222.0.30 () {56 vars in 1111 bytes} [Tue Oct 4 12:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:17.526988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:17.598951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:17.664188 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af35b-621a-4c09-98c8-57d913227063 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:17.706741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de67f-63de-4243-a05a-f138774110c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:17.707276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de67f-63de-4243-a05a-f138774110c9 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:17.707561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de67f-63de-4243-a05a-f138774110c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:17.707863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de67f-63de-4243-a05a-f138774110c9 None admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:17.708578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de67f-63de-4243-a05a-f138774110c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:17.708890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de67f-63de-4243-a05a-f138774110c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:17.710527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de67f-63de-4243-a05a-f138774110c9 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:17.725752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 620/1286] 10.222.0.30 () {56 vars in 1148 bytes} [Tue Oct 4 12:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:17.733335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:17.845689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687554b-b3c8-4cfa-97a2-9189a8c43455 None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:17.882772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fa7b-d3f9-4fa0-998b-03b448d61bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:17.883382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fa7b-d3f9-4fa0-998b-03b448d61bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:17.883666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fa7b-d3f9-4fa0-998b-03b448d61bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:17.883942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fa7b-d3f9-4fa0-998b-03b448d61bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:17.884671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fa7b-d3f9-4fa0-998b-03b448d61bc9 None admin] RBAC: Adding query filter params (role.id=b8bf66974c0448089a192ead432a35f2, scope.project.id=87ddc76b49714ed489f4127ea049425b, user.id=2243f5d37f1443e1a3d6fc7a8eadb46c) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:17.884990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fa7b-d3f9-4fa0-998b-03b448d61bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:17.886455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fa7b-d3f9-4fa0-998b-03b448d61bc9 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:17.892710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 667/1287] 10.222.0.30 () {56 vars in 1374 bytes} [Tue Oct 4 12:39:17 2022] GET /identity/v3/role_assignments?user.id=2243f5d37f1443e1a3d6fc7a8eadb46c&scope.project.id=87ddc76b49714ed489f4127ea049425b&role.id=b8bf66974c0448089a192ead432a35f2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:20.119610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec78b1-9f1d-408c-8fd0-fe4af7adb1a6 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:20.120159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec78b1-9f1d-408c-8fd0-fe4af7adb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:20.120254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec78b1-9f1d-408c-8fd0-fe4af7adb1a6 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:20.121689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 621/1288] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:39:20.130233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6b93-fdd2-4bf2-864c-aa49573cc080 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:20.130724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6b93-fdd2-4bf2-864c-aa49573cc080 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:20.131060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6b93-fdd2-4bf2-864c-aa49573cc080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:20.157666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c7cf6b93-fdd2-4bf2-864c-aa49573cc080 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:39:20.158939 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c7cf6b93-fdd2-4bf2-864c-aa49573cc080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:39:20.191898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:20.233862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 668/1289] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:39:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:39:20.514338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec78b1-9f1d-408c-8fd0-fe4af7adb1a6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:20.629333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec78b1-9f1d-408c-8fd0-fe4af7adb1a6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:20.644746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:20.670761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:20.671308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:20.671589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:20.671863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:20.672452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:20.674040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:20.683531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:20.684816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:20.686281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 622/1290] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:39:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:20.691311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6b93-fdd2-4bf2-864c-aa49573cc080 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:20.794803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6b93-fdd2-4bf2-864c-aa49573cc080 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:20.832354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154e0d-a816-41a6-914f-329080841033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:20.832973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154e0d-a816-41a6-914f-329080841033 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:20.833256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154e0d-a816-41a6-914f-329080841033 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:20.833537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154e0d-a816-41a6-914f-329080841033 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:20.834216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154e0d-a816-41a6-914f-329080841033 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:20.834522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154e0d-a816-41a6-914f-329080841033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:20.835913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154e0d-a816-41a6-914f-329080841033 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:20.841205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 669/1291] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Oct 4 12:39:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:20.849730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:20.959709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5888-0cac-4e13-9248-eecece9b8fc8 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:21.006895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3be5-8e36-445a-a5b5-76e54c46f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:21.007809 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3be5-8e36-445a-a5b5-76e54c46f99e None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:21.008278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3be5-8e36-445a-a5b5-76e54c46f99e None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:21.008731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3be5-8e36-445a-a5b5-76e54c46f99e None admin] PATH_INFO: `/v3/services` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:21.009576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3be5-8e36-445a-a5b5-76e54c46f99e None admin] RBAC: Adding query filter params (type=placement) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:21.010041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3be5-8e36-445a-a5b5-76e54c46f99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:21.012128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3be5-8e36-445a-a5b5-76e54c46f99e None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:21.022268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 623/1292] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Oct 4 12:39:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:23.213481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c270ca-bff1-43b5-816f-f68a117485c3 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:23.214106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c270ca-bff1-43b5-816f-f68a117485c3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:23.214106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c270ca-bff1-43b5-816f-f68a117485c3 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:23.215426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 670/1293] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:39:23.221267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77487a5-5258-4bdf-a384-3f5769236555 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:23.221725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77487a5-5258-4bdf-a384-3f5769236555 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:23.221862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77487a5-5258-4bdf-a384-3f5769236555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:23.240173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b77487a5-5258-4bdf-a384-3f5769236555 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:39:23.241361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b77487a5-5258-4bdf-a384-3f5769236555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:39:23.270627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:23.307745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 624/1294] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:39:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:39:23.578031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c270ca-bff1-43b5-816f-f68a117485c3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:23.610503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:23.678295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c270ca-bff1-43b5-816f-f68a117485c3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:23.709615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13f6b4-b6de-4dd2-8f37-88bf66dd04ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:23.710209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13f6b4-b6de-4dd2-8f37-88bf66dd04ac None admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:23.710482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13f6b4-b6de-4dd2-8f37-88bf66dd04ac None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:23.710746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13f6b4-b6de-4dd2-8f37-88bf66dd04ac None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:23.711387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13f6b4-b6de-4dd2-8f37-88bf66dd04ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:23.712738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13f6b4-b6de-4dd2-8f37-88bf66dd04ac None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:23.728106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 671/1295] 10.222.0.30 () {60 vars in 1141 bytes} [Tue Oct 4 12:39:23 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:39:25.911235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf860-3d1e-41a9-994e-7c14c6dd1ffe None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:25.911802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf860-3d1e-41a9-994e-7c14c6dd1ffe None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:25.911914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baf860-3d1e-41a9-994e-7c14c6dd1ffe None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:25.913290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 625/1296] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:39:25.918831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4faff-f1fe-40fb-9b17-fdae1bf6c74c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:25.919270 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4faff-f1fe-40fb-9b17-fdae1bf6c74c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:25.919359 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4faff-f1fe-40fb-9b17-fdae1bf6c74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:25.941572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f5e4faff-f1fe-40fb-9b17-fdae1bf6c74c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:39:25.942812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f5e4faff-f1fe-40fb-9b17-fdae1bf6c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:39:26.014713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 672/1297] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:39:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 12:39:26.280372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baf860-3d1e-41a9-994e-7c14c6dd1ffe None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:26.379457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baf860-3d1e-41a9-994e-7c14c6dd1ffe None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:26.414029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:26.414658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:26.414935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:26.415203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:26.415793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:26.417156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:26.426202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:26.427560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:26.428652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 626/1298] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:39:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:26.433268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4faff-f1fe-40fb-9b17-fdae1bf6c74c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:26.461089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:26.545637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4faff-f1fe-40fb-9b17-fdae1bf6c74c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:26.579807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:26.580414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:26.580698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:26.580974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:26.581629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] RBAC: Adding query filter params (name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:26.581942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:26.583319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:26.588417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 673/1299] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Oct 4 12:39:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:26.594643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:26.625584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:26.693880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3fc2b-2c8f-4cf5-9b90-e092e08fb51c None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:26.727293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526739e-7472-4dfd-b8a8-e5aea34efc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:26.727896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526739e-7472-4dfd-b8a8-e5aea34efc90 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:26.728174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526739e-7472-4dfd-b8a8-e5aea34efc90 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:26.728444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526739e-7472-4dfd-b8a8-e5aea34efc90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:26.729140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526739e-7472-4dfd-b8a8-e5aea34efc90 None admin] RBAC: Adding query filter params (interface=public, service_id=1bacada71e474744baeee8c6569697e2, region_id=RegionOne) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:26.729448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526739e-7472-4dfd-b8a8-e5aea34efc90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:26.730841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526739e-7472-4dfd-b8a8-e5aea34efc90 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:26.736128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 627/1300] 10.222.0.30 () {56 vars in 1251 bytes} [Tue Oct 4 12:39:26 2022] GET /identity/v3/endpoints?service_id=1bacada71e474744baeee8c6569697e2&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:26.741861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:26.822772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:26.842270 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c3a0-ab2f-4f72-be4a-5a32e2bcbe7e None admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:26.879886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3afb4-0844-4a6c-85c0-5d433d552aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:26.880502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3afb4-0844-4a6c-85c0-5d433d552aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:26.880784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3afb4-0844-4a6c-85c0-5d433d552aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:26.881058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3afb4-0844-4a6c-85c0-5d433d552aa2 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:26.881793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3afb4-0844-4a6c-85c0-5d433d552aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:26.883176 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3afb4-0844-4a6c-85c0-5d433d552aa2 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:26.890805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 674/1301] 10.222.0.30 () {56 vars in 1087 bytes} [Tue Oct 4 12:39:26 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:39:29.073364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8913a-9dcc-42c1-8da6-57cd91b6412b None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:29.073969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8913a-9dcc-42c1-8da6-57cd91b6412b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:29.073969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8913a-9dcc-42c1-8da6-57cd91b6412b None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:29.075287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 628/1302] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:39:29.081075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0be97-b574-4c73-a23b-591da9c3445b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:29.081491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0be97-b574-4c73-a23b-591da9c3445b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:29.081695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0be97-b574-4c73-a23b-591da9c3445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:29.099538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-11b0be97-b574-4c73-a23b-591da9c3445b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:39:29.100732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-11b0be97-b574-4c73-a23b-591da9c3445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:39:29.166918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 675/1303] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:39:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 12:39:29.439677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8913a-9dcc-42c1-8da6-57cd91b6412b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:29.532931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:29.540246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8913a-9dcc-42c1-8da6-57cd91b6412b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:29.577720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:29.578359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:29.578638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:29.578905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:29.579491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:29.580850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 12:39:29.589638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 12:39:29.590778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application with Lock( Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self._enter() Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application return self.creator() Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application created_value = creator( Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: ERROR keystone.server.flask.application Oct 04 12:39:29.592150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 629/1304] 10.222.0.30 () {56 vars in 1117 bytes} [Tue Oct 4 12:39:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 12:39:29.597582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0be97-b574-4c73-a23b-591da9c3445b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:29.673385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:29.696490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0be97-b574-4c73-a23b-591da9c3445b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:29.729513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ccc07-25c2-4860-be18-2183e13270e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:29.730151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ccc07-25c2-4860-be18-2183e13270e5 None admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:29.730435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ccc07-25c2-4860-be18-2183e13270e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:29.730710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ccc07-25c2-4860-be18-2183e13270e5 None admin] PATH_INFO: `/v3/services` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:29.731335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ccc07-25c2-4860-be18-2183e13270e5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:39:29.731640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ccc07-25c2-4860-be18-2183e13270e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:29.733568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ccc07-25c2-4860-be18-2183e13270e5 None admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:29.738968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 676/1305] 10.222.0.30 () {56 vars in 1116 bytes} [Tue Oct 4 12:39:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:39:29.744833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:39:29.846644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fbcea-db1c-496b-a03d-26fb0df15bc2 None admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:39:29.880390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6901255-50ce-4312-bf10-ec336a901a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:39:29.880989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901255-50ce-4312-bf10-ec336a901a4c None admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:39:29.881268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901255-50ce-4312-bf10-ec336a901a4c None admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:39:29.881541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6901255-50ce-4312-bf10-ec336a901a4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:39:29.882221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6901255-50ce-4312-bf10-ec336a901a4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:39:29.883599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6901255-50ce-4312-bf10-ec336a901a4c None admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:39:29.905503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 630/1306] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:39:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:39:39.736017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=30 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:39:39.899447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:36.298775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a46c-cd2c-4f38-8882-70916180e113 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:36.299554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a46c-cd2c-4f38-8882-70916180e113 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:36.299554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5a46c-cd2c-4f38-8882-70916180e113 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:36.300730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 677/1307] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:36.306662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762ef5e-b801-423a-948a-a466e5a260f7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:36.307438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762ef5e-b801-423a-948a-a466e5a260f7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:36.307438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762ef5e-b801-423a-948a-a466e5a260f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:36.461779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c762ef5e-b801-423a-948a-a466e5a260f7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:36.462929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c762ef5e-b801-423a-948a-a466e5a260f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:36.582749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 631/1308] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:40:36.879178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0344a-8898-4bb2-8b1a-79f0614fb682 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:36.879541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0344a-8898-4bb2-8b1a-79f0614fb682 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:36.879737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0344a-8898-4bb2-8b1a-79f0614fb682 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:36.881330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 678/1309] 10.222.0.30 () {54 vars in 964 bytes} [Tue Oct 4 12:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:36.888493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6fd76-7950-48b7-849f-975d74af8334 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:36.888783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6fd76-7950-48b7-849f-975d74af8334 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:36.889091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6fd76-7950-48b7-849f-975d74af8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:36.982211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-10f6fd76-7950-48b7-849f-975d74af8334 None None] MFA Rules not processed for user `3e1d9844633a4afaacbb1867b8bbe582`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:36.983637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-10f6fd76-7950-48b7-849f-975d74af8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:37.007297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:37.076393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 632/1310] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Oct 4 12:40:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:40:37.088536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0344a-8898-4bb2-8b1a-79f0614fb682 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:40:37.090682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6ff0344a-8898-4bb2-8b1a-79f0614fb682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:37.222632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0344a-8898-4bb2-8b1a-79f0614fb682 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:40:37.321275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cf263-dadf-437d-a537-11a9918b96c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:40:37.321948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf263-dadf-437d-a537-11a9918b96c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:37.322338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf263-dadf-437d-a537-11a9918b96c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:37.322693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf263-dadf-437d-a537-11a9918b96c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:37.324942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a06cf263-dadf-437d-a537-11a9918b96c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:37.397288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:37.477830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cf263-dadf-437d-a537-11a9918b96c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:40:37.479257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cf263-dadf-437d-a537-11a9918b96c0 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:40:37.505421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 679/1311] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:40:40.004583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b3eb-4e55-454d-8b78-edf56e07af9a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:40.005144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b3eb-4e55-454d-8b78-edf56e07af9a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:40.005144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841b3eb-4e55-454d-8b78-edf56e07af9a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:40.006562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 633/1312] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:40.014101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609103-6dba-4625-a313-d3c05f90b276 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:40.014664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609103-6dba-4625-a313-d3c05f90b276 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:40.014871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609103-6dba-4625-a313-d3c05f90b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:40.106485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-56609103-6dba-4625-a313-d3c05f90b276 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:40.107715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-56609103-6dba-4625-a313-d3c05f90b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:40.213947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 680/1313] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:40:40.502436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841b3eb-4e55-454d-8b78-edf56e07af9a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:40:40.503968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f841b3eb-4e55-454d-8b78-edf56e07af9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:40.617148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841b3eb-4e55-454d-8b78-edf56e07af9a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:40:40.695542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:40.697740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a309217-5de9-4702-9335-e4501ac6bc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:40:40.698459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309217-5de9-4702-9335-e4501ac6bc60 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:40.698873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309217-5de9-4702-9335-e4501ac6bc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:40.699155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a309217-5de9-4702-9335-e4501ac6bc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:40.701485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8a309217-5de9-4702-9335-e4501ac6bc60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:40.824793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a309217-5de9-4702-9335-e4501ac6bc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:40:40.826274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a309217-5de9-4702-9335-e4501ac6bc60 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:40:40.845526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 634/1314] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:40:43.371243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fe8d-79fe-46b0-8232-0c8e041814ba None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:43.371795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fe8d-79fe-46b0-8232-0c8e041814ba None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:43.371884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9fe8d-79fe-46b0-8232-0c8e041814ba None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:43.373214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 681/1315] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:43.379129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0466-d64c-44f0-8d22-0615d66683d4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:43.379673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0466-d64c-44f0-8d22-0615d66683d4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:43.379673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e0466-d64c-44f0-8d22-0615d66683d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:43.463079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c45e0466-d64c-44f0-8d22-0615d66683d4 None None] MFA Rules not processed for user `d75ad6ea00ed490582ccc4fdb2bdd495`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:43.464326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c45e0466-d64c-44f0-8d22-0615d66683d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:43.521999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:43.577297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 635/1316] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:40:43.861758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9fe8d-79fe-46b0-8232-0c8e041814ba None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:40:43.863334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-61d9fe8d-79fe-46b0-8232-0c8e041814ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:43.874581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:43.973905 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9fe8d-79fe-46b0-8232-0c8e041814ba None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:40:44.051839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8af3c-b4a3-4b6d-bf52-d32b1eb985c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:40:44.052619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8af3c-b4a3-4b6d-bf52-d32b1eb985c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:44.052819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8af3c-b4a3-4b6d-bf52-d32b1eb985c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:44.053086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8af3c-b4a3-4b6d-bf52-d32b1eb985c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:44.054740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b5a8af3c-b4a3-4b6d-bf52-d32b1eb985c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:44.118267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:44.166593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8af3c-b4a3-4b6d-bf52-d32b1eb985c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:40:44.168586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8af3c-b4a3-4b6d-bf52-d32b1eb985c1 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:40:44.187851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 682/1317] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:40:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:40:47.021646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec6f66-a2b9-4e46-9146-571c4a5e49df None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:47.022231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec6f66-a2b9-4e46-9146-571c4a5e49df None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:47.022231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec6f66-a2b9-4e46-9146-571c4a5e49df None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:47.023574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 636/1318] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:47.030534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30286-9fe9-48f5-bb42-e687167d6264 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:47.031341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30286-9fe9-48f5-bb42-e687167d6264 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:47.031555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30286-9fe9-48f5-bb42-e687167d6264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:47.107291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8fb30286-9fe9-48f5-bb42-e687167d6264 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:47.108566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8fb30286-9fe9-48f5-bb42-e687167d6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:47.217326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 683/1319] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:40:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:40:47.521288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9998-411c-4357-8cf2-440ca51fd03c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:47.521619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9998-411c-4357-8cf2-440ca51fd03c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:47.521909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9998-411c-4357-8cf2-440ca51fd03c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:47.523279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 637/1320] 10.222.0.30 () {54 vars in 964 bytes} [Tue Oct 4 12:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:47.530506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ac2c-e771-44dd-8e96-12afeb4290b6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:47.531002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ac2c-e771-44dd-8e96-12afeb4290b6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:47.531458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ac2c-e771-44dd-8e96-12afeb4290b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:47.557735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:47.615209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1e49ac2c-e771-44dd-8e96-12afeb4290b6 None None] MFA Rules not processed for user `3e1d9844633a4afaacbb1867b8bbe582`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:47.616576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1e49ac2c-e771-44dd-8e96-12afeb4290b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:47.698276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 684/1321] 10.222.0.30 () {58 vars in 1061 bytes} [Tue Oct 4 12:40:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:40:47.707487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9998-411c-4357-8cf2-440ca51fd03c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:40:47.709070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c16c9998-411c-4357-8cf2-440ca51fd03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:47.827109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9998-411c-4357-8cf2-440ca51fd03c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:40:47.903950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef4b6-d7a7-4f55-9b0b-915acec7dd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:40:47.904595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef4b6-d7a7-4f55-9b0b-915acec7dd28 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:47.904999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef4b6-d7a7-4f55-9b0b-915acec7dd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:47.905105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef4b6-d7a7-4f55-9b0b-915acec7dd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:47.906793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0a8ef4b6-d7a7-4f55-9b0b-915acec7dd28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:47.915506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:48.020362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ef4b6-d7a7-4f55-9b0b-915acec7dd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:40:48.021781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ef4b6-d7a7-4f55-9b0b-915acec7dd28 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:40:48.043318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 638/1322] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:40:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:40:51.889254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84505f7-c9c5-43ef-8f85-b7e7eafddcee None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:51.889908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84505f7-c9c5-43ef-8f85-b7e7eafddcee None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:51.889908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84505f7-c9c5-43ef-8f85-b7e7eafddcee None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:51.891302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 685/1323] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:51.898236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11e51c-c94e-412c-8f71-4eeea6ca993b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:51.898912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11e51c-c94e-412c-8f71-4eeea6ca993b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:51.898912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11e51c-c94e-412c-8f71-4eeea6ca993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:51.983129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1f11e51c-c94e-412c-8f71-4eeea6ca993b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:51.984756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1f11e51c-c94e-412c-8f71-4eeea6ca993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:52.061515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:52.109034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 639/1324] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:40:52.404283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84505f7-c9c5-43ef-8f85-b7e7eafddcee None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:40:52.405861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c84505f7-c9c5-43ef-8f85-b7e7eafddcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:52.538899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84505f7-c9c5-43ef-8f85-b7e7eafddcee None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:40:52.553745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:52.625099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89720a5e-0bda-472d-8ae3-6f4e7c31be6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:40:52.625754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720a5e-0bda-472d-8ae3-6f4e7c31be6a service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:52.626031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720a5e-0bda-472d-8ae3-6f4e7c31be6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:52.626304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89720a5e-0bda-472d-8ae3-6f4e7c31be6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:52.627936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-89720a5e-0bda-472d-8ae3-6f4e7c31be6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:52.746636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89720a5e-0bda-472d-8ae3-6f4e7c31be6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:40:52.748088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89720a5e-0bda-472d-8ae3-6f4e7c31be6a service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:40:52.767710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 686/1325] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:40:55.023494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc1a0a-148d-42e8-b5d3-5d5750db2350 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:55.024167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc1a0a-148d-42e8-b5d3-5d5750db2350 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:55.024167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc1a0a-148d-42e8-b5d3-5d5750db2350 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:55.026372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 640/1326] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:55.031410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e26b6-5fa9-459f-b7d9-ccd32409ff97 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:55.031934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e26b6-5fa9-459f-b7d9-ccd32409ff97 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:55.031934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e26b6-5fa9-459f-b7d9-ccd32409ff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:55.083164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:55.103382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-707e26b6-5fa9-459f-b7d9-ccd32409ff97 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:55.104594 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-707e26b6-5fa9-459f-b7d9-ccd32409ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:55.226232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 687/1327] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:40:55.511269 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc1a0a-148d-42e8-b5d3-5d5750db2350 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:40:55.511544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-98fc1a0a-148d-42e8-b5d3-5d5750db2350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:55.628854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc1a0a-148d-42e8-b5d3-5d5750db2350 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:40:55.706020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a63d-17a2-4032-9e2d-40f7670075d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:40:55.706555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a63d-17a2-4032-9e2d-40f7670075d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:55.706835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a63d-17a2-4032-9e2d-40f7670075d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:55.707107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a63d-17a2-4032-9e2d-40f7670075d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:55.708723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-20b7a63d-17a2-4032-9e2d-40f7670075d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:55.726973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:55.823801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a63d-17a2-4032-9e2d-40f7670075d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:40:55.825276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a63d-17a2-4032-9e2d-40f7670075d8 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:40:55.844857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 641/1328] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:40:58.088491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0b6c4-a6a5-4723-9849-838171f8fb4e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:58.089000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0b6c4-a6a5-4723-9849-838171f8fb4e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:58.089000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0b6c4-a6a5-4723-9849-838171f8fb4e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:58.090399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 688/1329] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:40:58.096336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7609b-91a7-4207-a6a3-47673d344649 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:58.096834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7609b-91a7-4207-a6a3-47673d344649 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:58.096947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7609b-91a7-4207-a6a3-47673d344649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:58.180211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-26e7609b-91a7-4207-a6a3-47673d344649 None None] MFA Rules not processed for user `d75ad6ea00ed490582ccc4fdb2bdd495`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:40:58.181434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-26e7609b-91a7-4207-a6a3-47673d344649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:58.251752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:58.288391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 642/1330] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:40:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:40:58.582293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0b6c4-a6a5-4723-9849-838171f8fb4e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:40:58.583887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6af0b6c4-a6a5-4723-9849-838171f8fb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:58.702931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0b6c4-a6a5-4723-9849-838171f8fb4e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:40:58.726035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:40:58.785925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c561f-2308-4e84-a783-557100e0b11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:40:58.786542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c561f-2308-4e84-a783-557100e0b11e service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:40:58.786821 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c561f-2308-4e84-a783-557100e0b11e service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:40:58.787094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c561f-2308-4e84-a783-557100e0b11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:40:58.789806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e84c561f-2308-4e84-a783-557100e0b11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:40:58.931815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c561f-2308-4e84-a783-557100e0b11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:40:58.935373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c561f-2308-4e84-a783-557100e0b11e service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:40:58.970559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 689/1331] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:40:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:01.395425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b8bf-5b1b-4ed7-a625-07efe56c90ed None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:01.395969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b8bf-5b1b-4ed7-a625-07efe56c90ed None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:01.395969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b8bf-5b1b-4ed7-a625-07efe56c90ed None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:01.397315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 643/1332] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:01.403088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eca47-8a89-4ab2-8742-08042a64195e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:01.403551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eca47-8a89-4ab2-8742-08042a64195e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:01.403656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eca47-8a89-4ab2-8742-08042a64195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:01.466852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:01.469711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-913eca47-8a89-4ab2-8742-08042a64195e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:01.471454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-913eca47-8a89-4ab2-8742-08042a64195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:01.566762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 690/1333] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:01.852981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b8bf-5b1b-4ed7-a625-07efe56c90ed None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:01.854578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f392b8bf-5b1b-4ed7-a625-07efe56c90ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:01.965728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b8bf-5b1b-4ed7-a625-07efe56c90ed None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:02.065911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a6bc2-9dba-453b-9b49-84f6ff18d4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:02.066439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6bc2-9dba-453b-9b49-84f6ff18d4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:02.066736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6bc2-9dba-453b-9b49-84f6ff18d4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:02.067008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6bc2-9dba-453b-9b49-84f6ff18d4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:02.068663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-083a6bc2-9dba-453b-9b49-84f6ff18d4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:02.095765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:02.178226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a6bc2-9dba-453b-9b49-84f6ff18d4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:02.179672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a6bc2-9dba-453b-9b49-84f6ff18d4c1 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:02.197259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 644/1334] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:04.477749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746d6de-f2af-46d9-bb62-7c857e7ed854 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:04.478312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746d6de-f2af-46d9-bb62-7c857e7ed854 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:04.478312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746d6de-f2af-46d9-bb62-7c857e7ed854 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:04.479657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 691/1335] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:04.485316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21aeec-2218-473b-ba34-781fe8910323 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:04.485832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21aeec-2218-473b-ba34-781fe8910323 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:04.485929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21aeec-2218-473b-ba34-781fe8910323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:04.553904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cd21aeec-2218-473b-ba34-781fe8910323 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:04.555134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cd21aeec-2218-473b-ba34-781fe8910323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:04.631742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:04.656180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 645/1336] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:04.944486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746d6de-f2af-46d9-bb62-7c857e7ed854 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:04.946088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c746d6de-f2af-46d9-bb62-7c857e7ed854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:05.052005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746d6de-f2af-46d9-bb62-7c857e7ed854 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:05.080682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:05.126839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d815ebf-10a7-4974-81cc-d2ea1fc2dba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:05.127452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815ebf-10a7-4974-81cc-d2ea1fc2dba5 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:05.127730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815ebf-10a7-4974-81cc-d2ea1fc2dba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:05.128002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815ebf-10a7-4974-81cc-d2ea1fc2dba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:05.129630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2d815ebf-10a7-4974-81cc-d2ea1fc2dba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:05.241625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815ebf-10a7-4974-81cc-d2ea1fc2dba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:05.243913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d815ebf-10a7-4974-81cc-d2ea1fc2dba5 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:05.264278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 692/1337] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:07.804783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901059-2df2-45a0-a441-a6f2b0d40cb1 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:07.805359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901059-2df2-45a0-a441-a6f2b0d40cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:07.805359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3901059-2df2-45a0-a441-a6f2b0d40cb1 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:07.806653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 646/1338] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:07.812207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f136e76-6df2-4a1c-b6a3-9b49b500439c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:07.812675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f136e76-6df2-4a1c-b6a3-9b49b500439c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:07.812781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f136e76-6df2-4a1c-b6a3-9b49b500439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:07.882957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7f136e76-6df2-4a1c-b6a3-9b49b500439c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:07.884181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7f136e76-6df2-4a1c-b6a3-9b49b500439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:07.892574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:07.983890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 693/1339] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:08.262385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3901059-2df2-45a0-a441-a6f2b0d40cb1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:08.263943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b3901059-2df2-45a0-a441-a6f2b0d40cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:08.369301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3901059-2df2-45a0-a441-a6f2b0d40cb1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:08.454399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289554f-d977-498e-81b7-2c511eb6ee4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:08.455008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289554f-d977-498e-81b7-2c511eb6ee4d service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:08.455287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289554f-d977-498e-81b7-2c511eb6ee4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:08.455561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289554f-d977-498e-81b7-2c511eb6ee4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:08.457170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7289554f-d977-498e-81b7-2c511eb6ee4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:08.494239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:08.572946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289554f-d977-498e-81b7-2c511eb6ee4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:08.574923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289554f-d977-498e-81b7-2c511eb6ee4d service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:08.595975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 647/1340] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:13.004513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0d3bc-383f-4cef-a3bc-f9dea43ed6ce None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:13.005104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0d3bc-383f-4cef-a3bc-f9dea43ed6ce None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:13.005322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0d3bc-383f-4cef-a3bc-f9dea43ed6ce None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:13.006771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 694/1341] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:13.018241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db184-10ab-4374-b19b-5ae7c64c66b8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:13.018764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db184-10ab-4374-b19b-5ae7c64c66b8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:13.018886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8db184-10ab-4374-b19b-5ae7c64c66b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:13.091788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ce8db184-10ab-4374-b19b-5ae7c64c66b8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:13.093022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ce8db184-10ab-4374-b19b-5ae7c64c66b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:13.181140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:13.193128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 648/1342] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:13.521986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0d3bc-383f-4cef-a3bc-f9dea43ed6ce None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:13.523615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d9b0d3bc-383f-4cef-a3bc-f9dea43ed6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:13.631925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0d3bc-383f-4cef-a3bc-f9dea43ed6ce None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:13.671976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:13.708459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32fd4f-bfd8-4a12-8969-7438ae4fa955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:13.709067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fd4f-bfd8-4a12-8969-7438ae4fa955 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:13.709349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fd4f-bfd8-4a12-8969-7438ae4fa955 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:13.709641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32fd4f-bfd8-4a12-8969-7438ae4fa955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:13.711245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ce32fd4f-bfd8-4a12-8969-7438ae4fa955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:13.824814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32fd4f-bfd8-4a12-8969-7438ae4fa955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:13.826285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32fd4f-bfd8-4a12-8969-7438ae4fa955 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:13.844758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 695/1343] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:16.666457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9468-be71-419d-8ee1-83e080d80633 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:16.667553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9468-be71-419d-8ee1-83e080d80633 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:16.667650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9468-be71-419d-8ee1-83e080d80633 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:16.669038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 649/1344] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:16.674444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d807b0-3fa7-4b0b-967f-c8e6355dec5a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:16.674897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d807b0-3fa7-4b0b-967f-c8e6355dec5a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:16.674991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d807b0-3fa7-4b0b-967f-c8e6355dec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:16.742331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c5d807b0-3fa7-4b0b-967f-c8e6355dec5a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:16.743533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c5d807b0-3fa7-4b0b-967f-c8e6355dec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:16.761951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:16.841614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 696/1345] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:17.126054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b9468-be71-419d-8ee1-83e080d80633 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:17.127622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-273b9468-be71-419d-8ee1-83e080d80633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:17.238274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b9468-be71-419d-8ee1-83e080d80633 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:17.313136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9f4eb-3f27-4989-95b3-3b6deef4d705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:17.313772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9f4eb-3f27-4989-95b3-3b6deef4d705 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:17.314053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9f4eb-3f27-4989-95b3-3b6deef4d705 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:17.314320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9f4eb-3f27-4989-95b3-3b6deef4d705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:17.315901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-25b9f4eb-3f27-4989-95b3-3b6deef4d705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:17.362380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:17.436169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9f4eb-3f27-4989-95b3-3b6deef4d705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:17.437689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9f4eb-3f27-4989-95b3-3b6deef4d705 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:17.456191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 650/1346] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:21.771798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05770-4ea4-4510-8c43-1606d0cdda0e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:21.772364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05770-4ea4-4510-8c43-1606d0cdda0e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:21.772364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05770-4ea4-4510-8c43-1606d0cdda0e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:21.774046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 697/1347] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:21.780075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214d78f-1953-4cf3-825f-3463f97e8b4e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:21.780593 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214d78f-1953-4cf3-825f-3463f97e8b4e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:21.780819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214d78f-1953-4cf3-825f-3463f97e8b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:21.867610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7214d78f-1953-4cf3-825f-3463f97e8b4e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:21.868848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7214d78f-1953-4cf3-825f-3463f97e8b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:21.987898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:21.993723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 651/1348] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:22.283718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05770-4ea4-4510-8c43-1606d0cdda0e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:22.285526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d7f05770-4ea4-4510-8c43-1606d0cdda0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:22.398104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05770-4ea4-4510-8c43-1606d0cdda0e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:22.448521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:22.476256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b33b6a-a9f7-45a9-a685-bf049248f037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:22.476870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33b6a-a9f7-45a9-a685-bf049248f037 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:22.477146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33b6a-a9f7-45a9-a685-bf049248f037 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:22.477424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33b6a-a9f7-45a9-a685-bf049248f037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:22.479180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-91b33b6a-a9f7-45a9-a685-bf049248f037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:22.589939 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b33b6a-a9f7-45a9-a685-bf049248f037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:22.591388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b33b6a-a9f7-45a9-a685-bf049248f037 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:22.610395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 698/1349] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:41:27.749647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9655c5-8f68-44d9-9741-cb6570cf6fa7 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:27.750217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9655c5-8f68-44d9-9741-cb6570cf6fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:27.750447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9655c5-8f68-44d9-9741-cb6570cf6fa7 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:27.753648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 652/1350] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:41:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:27.763214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dfe61-bd5a-4ee4-b032-47ec42ed0c6d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:27.763974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dfe61-bd5a-4ee4-b032-47ec42ed0c6d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:27.763974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dfe61-bd5a-4ee4-b032-47ec42ed0c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:27.891109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a32dfe61-bd5a-4ee4-b032-47ec42ed0c6d None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:27.892466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a32dfe61-bd5a-4ee4-b032-47ec42ed0c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:27.920217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:28.062210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 699/1351] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:41:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:32.528880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9f95b-2cc7-433a-9634-28a1cc93d8f2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:32.529887 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9f95b-2cc7-433a-9634-28a1cc93d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:32.530381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9f95b-2cc7-433a-9634-28a1cc93d8f2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:32.532304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 653/1352] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:32.539922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45eef7-b4c2-47e4-9653-715d57cd2981 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:32.540882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45eef7-b4c2-47e4-9653-715d57cd2981 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:32.541941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45eef7-b4c2-47e4-9653-715d57cd2981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:32.632073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8e45eef7-b4c2-47e4-9653-715d57cd2981 None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:32.633705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8e45eef7-b4c2-47e4-9653-715d57cd2981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:32.729991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:32.776721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 700/1353] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:41:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:34.398054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a536-ed82-4cba-915c-f80a95a5a95c None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:34.398629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a536-ed82-4cba-915c-f80a95a5a95c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:34.398629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a536-ed82-4cba-915c-f80a95a5a95c None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:34.400244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 654/1354] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:34.406447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e073f2d-cdf3-4e4c-b400-153acdb7478d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:34.407017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e073f2d-cdf3-4e4c-b400-153acdb7478d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:34.407017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e073f2d-cdf3-4e4c-b400-153acdb7478d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:34.495984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0e073f2d-cdf3-4e4c-b400-153acdb7478d None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:34.497200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0e073f2d-cdf3-4e4c-b400-153acdb7478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:34.612209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 701/1355] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:38.350460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe186-3b4d-44b0-b808-a92ef7c05afe None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:38.351534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe186-3b4d-44b0-b808-a92ef7c05afe None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:38.352088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe186-3b4d-44b0-b808-a92ef7c05afe None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:38.359590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 655/1356] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:41:38.361115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5537b1-c4b0-4774-ab92-0ea70126151b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:38.362006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5537b1-c4b0-4774-ab92-0ea70126151b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:38.362505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5537b1-c4b0-4774-ab92-0ea70126151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:38.429017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:38.473591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9e5537b1-c4b0-4774-ab92-0ea70126151b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:38.474847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9e5537b1-c4b0-4774-ab92-0ea70126151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:38.582275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 702/1357] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:38.890781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5599-3cd7-45d3-8cda-caf82223d4d2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:38.891543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5599-3cd7-45d3-8cda-caf82223d4d2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:38.893143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e5599-3cd7-45d3-8cda-caf82223d4d2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:38.896655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 656/1358] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 4 12:41:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:38.906089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5937b-f10f-42ed-8386-46164186b9c1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:38.906383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5937b-f10f-42ed-8386-46164186b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:38.906763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5937b-f10f-42ed-8386-46164186b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:39.014714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-45b5937b-f10f-42ed-8386-46164186b9c1 None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:39.015961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-45b5937b-f10f-42ed-8386-46164186b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:39.086568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:39.176629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 703/1359] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 4 12:41:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:39.186028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5599-3cd7-45d3-8cda-caf82223d4d2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:39.187568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d29e5599-3cd7-45d3-8cda-caf82223d4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:39.375722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e5599-3cd7-45d3-8cda-caf82223d4d2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:39.501421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:39.567364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137ffe9-a5f3-4174-8a6f-d7a69987ece7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:39.568467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137ffe9-a5f3-4174-8a6f-d7a69987ece7 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:39.568973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137ffe9-a5f3-4174-8a6f-d7a69987ece7 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:39.569457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137ffe9-a5f3-4174-8a6f-d7a69987ece7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:39.571394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c137ffe9-a5f3-4174-8a6f-d7a69987ece7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:39.680643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137ffe9-a5f3-4174-8a6f-d7a69987ece7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:39.683270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137ffe9-a5f3-4174-8a6f-d7a69987ece7 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:39.705925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 657/1360] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:42.382600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3948-2ca5-4490-bd79-c1be13631ef2 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:42.383185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3948-2ca5-4490-bd79-c1be13631ef2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:42.383185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a3948-2ca5-4490-bd79-c1be13631ef2 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:42.384514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 704/1361] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:42.390888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862aee-6e67-4b43-ad7d-8eba621e94b4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:42.391379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862aee-6e67-4b43-ad7d-8eba621e94b4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:42.391487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862aee-6e67-4b43-ad7d-8eba621e94b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:42.469944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4d862aee-6e67-4b43-ad7d-8eba621e94b4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:42.471194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4d862aee-6e67-4b43-ad7d-8eba621e94b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:42.516686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:42.589642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 658/1362] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:42.912969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a3948-2ca5-4490-bd79-c1be13631ef2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:42.914952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-575a3948-2ca5-4490-bd79-c1be13631ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:43.125464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a3948-2ca5-4490-bd79-c1be13631ef2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:43.157148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:43.378871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4d32-d2ba-49fd-839c-6b4a9f8800e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:43.379932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4d32-d2ba-49fd-839c-6b4a9f8800e1 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:43.380377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4d32-d2ba-49fd-839c-6b4a9f8800e1 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:43.380811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4d32-d2ba-49fd-839c-6b4a9f8800e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:43.383788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-144a4d32-d2ba-49fd-839c-6b4a9f8800e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:43.512720 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4d32-d2ba-49fd-839c-6b4a9f8800e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:43.514399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4d32-d2ba-49fd-839c-6b4a9f8800e1 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:43.535792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 705/1363] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:46.245316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75d5e-af51-46a6-97ed-b01c368ff922 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:46.245943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75d5e-af51-46a6-97ed-b01c368ff922 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:46.246317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef75d5e-af51-46a6-97ed-b01c368ff922 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:46.249698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 659/1364] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:46.255362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1e0e3-4554-4568-8281-b1efcfb981db None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:46.256137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1e0e3-4554-4568-8281-b1efcfb981db None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:46.256137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1e0e3-4554-4568-8281-b1efcfb981db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:46.274069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:46.337566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-63e1e0e3-4554-4568-8281-b1efcfb981db None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:46.339103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-63e1e0e3-4554-4568-8281-b1efcfb981db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:46.464323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 706/1365] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:41:46.760917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bde1-93d1-4351-b9e3-6a4c8fb07a7e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:46.761200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bde1-93d1-4351-b9e3-6a4c8fb07a7e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:46.761461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bde1-93d1-4351-b9e3-6a4c8fb07a7e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:46.763068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 660/1366] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 4 12:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:46.768793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d893ff-641d-49b0-96d1-38650d4355ca None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:46.769127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d893ff-641d-49b0-96d1-38650d4355ca None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:46.769361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d893ff-641d-49b0-96d1-38650d4355ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:46.867889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-02d893ff-641d-49b0-96d1-38650d4355ca None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:46.869947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-02d893ff-641d-49b0-96d1-38650d4355ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:46.917894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:47.032143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 707/1367] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 4 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:47.040495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8bde1-93d1-4351-b9e3-6a4c8fb07a7e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:47.042670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-09a8bde1-93d1-4351-b9e3-6a4c8fb07a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:47.222622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8bde1-93d1-4351-b9e3-6a4c8fb07a7e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:47.246071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:47.364644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f91d2c-937d-4434-b1ae-006be4e2c871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:47.365286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91d2c-937d-4434-b1ae-006be4e2c871 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:47.365568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91d2c-937d-4434-b1ae-006be4e2c871 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:47.365891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91d2c-937d-4434-b1ae-006be4e2c871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:47.367913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-83f91d2c-937d-4434-b1ae-006be4e2c871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:47.490623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f91d2c-937d-4434-b1ae-006be4e2c871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:47.492333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f91d2c-937d-4434-b1ae-006be4e2c871 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:47.513958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 661/1368] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:48.803792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb2ac-3592-46aa-a80e-52229c6adea9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:48.804315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb2ac-3592-46aa-a80e-52229c6adea9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:48.804315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcb2ac-3592-46aa-a80e-52229c6adea9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:48.805879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 708/1369] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:48.811490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6910c2-3848-42b5-be1a-705bdd689a7f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:48.812116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6910c2-3848-42b5-be1a-705bdd689a7f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:48.812116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6910c2-3848-42b5-be1a-705bdd689a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:48.850575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:48.893744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8d6910c2-3848-42b5-be1a-705bdd689a7f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:48.895050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8d6910c2-3848-42b5-be1a-705bdd689a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:49.016485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 662/1370] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:49.333921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283487-69f5-411d-b5f5-243fd8d39690 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:49.334339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283487-69f5-411d-b5f5-243fd8d39690 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:49.334736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31283487-69f5-411d-b5f5-243fd8d39690 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:49.336500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 709/1371] 10.222.0.30 () {54 vars in 963 bytes} [Tue Oct 4 12:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:49.342154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9bbd-5b42-4328-b86e-6d29b1e81440 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:49.342581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9bbd-5b42-4328-b86e-6d29b1e81440 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:49.343540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f9bbd-5b42-4328-b86e-6d29b1e81440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:49.455358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cd9f9bbd-5b42-4328-b86e-6d29b1e81440 None None] MFA Rules not processed for user `d75de5eca91b46daaffd3bd79b69a6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:49.456792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cd9f9bbd-5b42-4328-b86e-6d29b1e81440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:49.516500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:49.558209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 663/1372] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Oct 4 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:49.567254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283487-69f5-411d-b5f5-243fd8d39690 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:49.570340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-31283487-69f5-411d-b5f5-243fd8d39690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:49.745439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31283487-69f5-411d-b5f5-243fd8d39690 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:49.806248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:49.840290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b112c8-7569-4135-af2d-a6fe59037b51 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:49.840741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b112c8-7569-4135-af2d-a6fe59037b51 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:49.840986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b112c8-7569-4135-af2d-a6fe59037b51 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:49.842309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 664/1373] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:41:49.848732 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09bd6-ef70-48bb-9dcb-c3b9a425fe7b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:49.849076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09bd6-ef70-48bb-9dcb-c3b9a425fe7b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:49.849505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09bd6-ef70-48bb-9dcb-c3b9a425fe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:49.850431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:49.851544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:49.851544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:49.851544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:49.861591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:49.950239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1dd09bd6-ef70-48bb-9dcb-c3b9a425fe7b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:49.950776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1dd09bd6-ef70-48bb-9dcb-c3b9a425fe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:50.006295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:50.008174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:50.032652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 710/1374] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:50.104852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 665/1375] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:41:50.396103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:50.397285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:50.481642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:50.517264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28c6b1-7255-4d21-bc9e-77e7340fb07e service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:50.635750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fde6ab-0173-41ca-b175-7d8870380fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:50.636360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fde6ab-0173-41ca-b175-7d8870380fef service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:50.636638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fde6ab-0173-41ca-b175-7d8870380fef service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:50.636909 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fde6ab-0173-41ca-b175-7d8870380fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:50.638542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-39fde6ab-0173-41ca-b175-7d8870380fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:50.723596 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:50.737495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fde6ab-0173-41ca-b175-7d8870380fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:50.739197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fde6ab-0173-41ca-b175-7d8870380fef service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:50.763269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 711/1376] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:41:53.021333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c776a4-6164-457f-830a-df9c5df3dec8 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:53.022057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c776a4-6164-457f-830a-df9c5df3dec8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:53.022057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c776a4-6164-457f-830a-df9c5df3dec8 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:53.023558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 666/1377] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:53.028948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121a89-3280-4883-a506-a884b9de5963 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:53.029387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121a89-3280-4883-a506-a884b9de5963 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:53.029534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121a89-3280-4883-a506-a884b9de5963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:53.098646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-75121a89-3280-4883-a506-a884b9de5963 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:53.099862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-75121a89-3280-4883-a506-a884b9de5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:53.218712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 712/1378] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:53.519319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c776a4-6164-457f-830a-df9c5df3dec8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:53.521335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-44c776a4-6164-457f-830a-df9c5df3dec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:53.578740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:53.695535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c776a4-6164-457f-830a-df9c5df3dec8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:53.907911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be48ff-87b8-4a63-95d0-0af537e27147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:53.909048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be48ff-87b8-4a63-95d0-0af537e27147 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:53.910914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be48ff-87b8-4a63-95d0-0af537e27147 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:53.911938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be48ff-87b8-4a63-95d0-0af537e27147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:53.916970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-86be48ff-87b8-4a63-95d0-0af537e27147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:53.944087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:54.068688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be48ff-87b8-4a63-95d0-0af537e27147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:54.070237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be48ff-87b8-4a63-95d0-0af537e27147 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:54.092357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 667/1379] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:56.456754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a6ea6-7d1f-4466-a274-8a12a8e22b3f None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:56.457326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a6ea6-7d1f-4466-a274-8a12a8e22b3f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:56.457326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a6ea6-7d1f-4466-a274-8a12a8e22b3f None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:56.459063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 713/1380] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:56.465683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858efae-87ce-45bf-994e-c64747fd5af8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:56.466326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858efae-87ce-45bf-994e-c64747fd5af8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:56.466326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858efae-87ce-45bf-994e-c64747fd5af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:56.550773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2858efae-87ce-45bf-994e-c64747fd5af8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:41:56.552333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2858efae-87ce-45bf-994e-c64747fd5af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:56.653578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:56.669498 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 668/1381] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:41:56.961480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a6ea6-7d1f-4466-a274-8a12a8e22b3f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:41:56.963623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c56a6ea6-7d1f-4466-a274-8a12a8e22b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:57.034217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:57.140281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a6ea6-7d1f-4466-a274-8a12a8e22b3f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:41:57.281178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba8a3e-7ebc-40b5-8052-28784c3915c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:41:57.281890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba8a3e-7ebc-40b5-8052-28784c3915c4 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:57.282165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba8a3e-7ebc-40b5-8052-28784c3915c4 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:57.282423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba8a3e-7ebc-40b5-8052-28784c3915c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:57.284061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2eba8a3e-7ebc-40b5-8052-28784c3915c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:41:57.310374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:41:57.394545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba8a3e-7ebc-40b5-8052-28784c3915c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:41:57.396055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba8a3e-7ebc-40b5-8052-28784c3915c4 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:41:57.424414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 714/1382] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:41:59.885214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef11abf-8435-4f87-a75a-5b2f8db68c57 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:59.885943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef11abf-8435-4f87-a75a-5b2f8db68c57 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:59.886069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef11abf-8435-4f87-a75a-5b2f8db68c57 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:41:59.887836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 669/1383] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:41:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:41:59.898076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd2a5f-555d-4707-a668-afb9939efc45 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:41:59.898944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd2a5f-555d-4707-a668-afb9939efc45 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:41:59.899287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd2a5f-555d-4707-a668-afb9939efc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:00.017816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-75fd2a5f-555d-4707-a668-afb9939efc45 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:00.022546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-75fd2a5f-555d-4707-a668-afb9939efc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:00.175231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:00.179855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 715/1384] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:00.574403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef11abf-8435-4f87-a75a-5b2f8db68c57 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:00.577260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-aef11abf-8435-4f87-a75a-5b2f8db68c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:00.857704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef11abf-8435-4f87-a75a-5b2f8db68c57 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:00.959226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:01.021758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffa195-4ada-44b5-be35-656c13f95197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:01.022384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa195-4ada-44b5-be35-656c13f95197 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:01.022667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa195-4ada-44b5-be35-656c13f95197 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:01.022956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffa195-4ada-44b5-be35-656c13f95197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:01.026020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2dffa195-4ada-44b5-be35-656c13f95197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:01.154112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa195-4ada-44b5-be35-656c13f95197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:01.155677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffa195-4ada-44b5-be35-656c13f95197 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:01.178038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 670/1385] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:04.230792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a736b-9a99-4a2b-ae08-d6657fedf21d None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:04.231454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a736b-9a99-4a2b-ae08-d6657fedf21d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:04.231610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a736b-9a99-4a2b-ae08-d6657fedf21d None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:04.233312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 716/1386] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:42:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:04.240892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889fd4b-93cf-44d6-91e4-41408c0dbe2f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:04.241452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889fd4b-93cf-44d6-91e4-41408c0dbe2f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:04.241708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889fd4b-93cf-44d6-91e4-41408c0dbe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:04.342192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f889fd4b-93cf-44d6-91e4-41408c0dbe2f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:04.343473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f889fd4b-93cf-44d6-91e4-41408c0dbe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:04.379354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:04.499870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 671/1387] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:04.806878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a736b-9a99-4a2b-ae08-d6657fedf21d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:04.808427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-436a736b-9a99-4a2b-ae08-d6657fedf21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:04.984002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a736b-9a99-4a2b-ae08-d6657fedf21d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:05.065046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:05.113880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911402-f79d-4c70-9e3a-f9208b25ea63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:05.114497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911402-f79d-4c70-9e3a-f9208b25ea63 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:05.114777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911402-f79d-4c70-9e3a-f9208b25ea63 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:05.115042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911402-f79d-4c70-9e3a-f9208b25ea63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:05.116721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-15911402-f79d-4c70-9e3a-f9208b25ea63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:05.241468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911402-f79d-4c70-9e3a-f9208b25ea63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:05.244619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911402-f79d-4c70-9e3a-f9208b25ea63 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:05.284370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 717/1388] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:07.061208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127b0f-df15-410e-92c9-72a7b1dc1568 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:07.062040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127b0f-df15-410e-92c9-72a7b1dc1568 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:07.062155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127b0f-df15-410e-92c9-72a7b1dc1568 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:07.064082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 672/1389] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:07.071212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69e7b-152f-4d74-80b0-72d8a284fe35 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:07.071797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69e7b-152f-4d74-80b0-72d8a284fe35 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:07.071797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69e7b-152f-4d74-80b0-72d8a284fe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:07.155292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-14f69e7b-152f-4d74-80b0-72d8a284fe35 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:07.156502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-14f69e7b-152f-4d74-80b0-72d8a284fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:07.201557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:07.278646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 718/1390] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:07.564462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6b61-edda-48c1-9737-df4a81c424c7 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:07.564897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6b61-edda-48c1-9737-df4a81c424c7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:07.565287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6b61-edda-48c1-9737-df4a81c424c7 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:07.566991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 673/1391] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:42:07.573241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d694e-f28c-40af-a35a-a1b64b985b98 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:07.573719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d694e-f28c-40af-a35a-a1b64b985b98 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:07.574025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d694e-f28c-40af-a35a-a1b64b985b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:07.587802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e3d6-bf7e-4c1a-8a3d-bd394dbb2c47 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:07.588087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e3d6-bf7e-4c1a-8a3d-bd394dbb2c47 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:07.588464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e3d6-bf7e-4c1a-8a3d-bd394dbb2c47 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:07.590793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 674/1392] 10.222.0.30 () {54 vars in 962 bytes} [Tue Oct 4 12:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:07.598652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08029931-9f2b-47b4-9d48-2e2277799339 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:07.599008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08029931-9f2b-47b4-9d48-2e2277799339 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:07.599352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08029931-9f2b-47b4-9d48-2e2277799339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:07.654300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7e1d694e-f28c-40af-a35a-a1b64b985b98 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:07.655519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7e1d694e-f28c-40af-a35a-a1b64b985b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:07.695182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-08029931-9f2b-47b4-9d48-2e2277799339 None None] MFA Rules not processed for user `cdb8a57a383c475caff51c3d6d5c6a47`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:07.696339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-08029931-9f2b-47b4-9d48-2e2277799339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:07.769645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 719/1393] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:42:07.785590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 675/1394] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Oct 4 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:42:07.795315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d694e-f28c-40af-a35a-a1b64b985b98 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:07.796513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7e1d694e-f28c-40af-a35a-a1b64b985b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:07.817439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:07.902009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d694e-f28c-40af-a35a-a1b64b985b98 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:07.984152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7810584-563d-4177-a28a-c52a2aec2bc0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdb8a57a383c475caff51c3d6d5c6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:07.984740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7810584-563d-4177-a28a-c52a2aec2bc0 service glance] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:07.984952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7810584-563d-4177-a28a-c52a2aec2bc0 service glance] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:07.985260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7810584-563d-4177-a28a-c52a2aec2bc0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:07.987196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b7810584-563d-4177-a28a-c52a2aec2bc0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:08.069923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08029931-9f2b-47b4-9d48-2e2277799339 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:08.071165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-08029931-9f2b-47b4-9d48-2e2277799339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:08.076823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:08.098248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:08.121670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7810584-563d-4177-a28a-c52a2aec2bc0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:08.123231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7810584-563d-4177-a28a-c52a2aec2bc0 service glance] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:08.142626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 720/1395] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:08.206661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08029931-9f2b-47b4-9d48-2e2277799339 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:08.341959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cfa8e-63f8-4b88-bb39-d00603a131e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:08.342600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cfa8e-63f8-4b88-bb39-d00603a131e9 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:08.342920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cfa8e-63f8-4b88-bb39-d00603a131e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:08.343240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cfa8e-63f8-4b88-bb39-d00603a131e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:08.345158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-050cfa8e-63f8-4b88-bb39-d00603a131e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:08.361326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:08.484847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cfa8e-63f8-4b88-bb39-d00603a131e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:08.486507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cfa8e-63f8-4b88-bb39-d00603a131e9 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:08.516615 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 676/1396] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:42:09.008145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026791-77cc-4fa2-a857-104a72adceb1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:09.008483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026791-77cc-4fa2-a857-104a72adceb1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:09.008700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026791-77cc-4fa2-a857-104a72adceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:09.092090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-31026791-77cc-4fa2-a857-104a72adceb1 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:09.093322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-31026791-77cc-4fa2-a857-104a72adceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:09.191280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 721/1397] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:42:09.240791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ad04a-fe72-488c-85b4-63dc8eb0e699 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:09.241431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ad04a-fe72-488c-85b4-63dc8eb0e699 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:09.241431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ad04a-fe72-488c-85b4-63dc8eb0e699 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:09.242728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 677/1398] 10.222.0.30 () {54 vars in 943 bytes} [Tue Oct 4 12:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:09.250171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d553b-67f9-494b-8237-4f767734bdbc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:09.250611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d553b-67f9-494b-8237-4f767734bdbc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:09.251022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d553b-67f9-494b-8237-4f767734bdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:09.319066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:09.341657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3f4d553b-67f9-494b-8237-4f767734bdbc None None] MFA Rules not processed for user `a5f678debf35484989502439a8780ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:09.342922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3f4d553b-67f9-494b-8237-4f767734bdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:09.527836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 722/1399] 10.222.0.30 () {58 vars in 1040 bytes} [Tue Oct 4 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:09.537702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ad04a-fe72-488c-85b4-63dc8eb0e699 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:09.539233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5c4ad04a-fe72-488c-85b4-63dc8eb0e699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:09.689566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ad04a-fe72-488c-85b4-63dc8eb0e699 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:09.692558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:09.808776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0c3b3-a08d-4d7c-81c5-edebf1a513e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:09.809468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0c3b3-a08d-4d7c-81c5-edebf1a513e5 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:09.809904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0c3b3-a08d-4d7c-81c5-edebf1a513e5 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:09.810291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0c3b3-a08d-4d7c-81c5-edebf1a513e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:09.812165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3ae0c3b3-a08d-4d7c-81c5-edebf1a513e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:09.907930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0c3b3-a08d-4d7c-81c5-edebf1a513e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:09.909622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0c3b3-a08d-4d7c-81c5-edebf1a513e5 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:09.921040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 678/1400] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:42:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:42:10.936390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba358-49b4-408c-9945-b7271ff7c061 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:10.937007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba358-49b4-408c-9945-b7271ff7c061 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:10.937360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dba358-49b4-408c-9945-b7271ff7c061 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:10.945761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 723/1401] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:42:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:10.950367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3e9c-bd7b-4afe-946d-e7506c1be056 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:10.950367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3e9c-bd7b-4afe-946d-e7506c1be056 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:10.953502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3e9c-bd7b-4afe-946d-e7506c1be056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:11.046649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:11.072624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b0ef3e9c-bd7b-4afe-946d-e7506c1be056 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:11.074080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b0ef3e9c-bd7b-4afe-946d-e7506c1be056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:11.203901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 679/1402] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:11.501256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dba358-49b4-408c-9945-b7271ff7c061 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:11.503888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-70dba358-49b4-408c-9945-b7271ff7c061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:11.686996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:11.765544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dba358-49b4-408c-9945-b7271ff7c061 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:11.958088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c0b1d-18e7-45b8-89e8-95a99e5482b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:11.959169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0b1d-18e7-45b8-89e8-95a99e5482b8 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:11.959169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0b1d-18e7-45b8-89e8-95a99e5482b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:11.959509 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c0b1d-18e7-45b8-89e8-95a99e5482b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:11.960896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a78c0b1d-18e7-45b8-89e8-95a99e5482b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:12.061854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:12.088209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c0b1d-18e7-45b8-89e8-95a99e5482b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:12.090010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c0b1d-18e7-45b8-89e8-95a99e5482b8 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:12.113865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 724/1403] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:14.510065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ee99-a236-4865-b2a6-c36cd61c479b None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:14.510883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ee99-a236-4865-b2a6-c36cd61c479b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:14.510883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ee99-a236-4865-b2a6-c36cd61c479b None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:14.512033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 680/1404] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:14.517705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34bdc-7c67-4ed2-9b3d-595a9d12d3fb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:14.518249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34bdc-7c67-4ed2-9b3d-595a9d12d3fb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:14.518249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34bdc-7c67-4ed2-9b3d-595a9d12d3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:14.594517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8fc34bdc-7c67-4ed2-9b3d-595a9d12d3fb None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:14.595811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8fc34bdc-7c67-4ed2-9b3d-595a9d12d3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:14.733729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 725/1405] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:15.016823 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030ee99-a236-4865-b2a6-c36cd61c479b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:15.019365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0030ee99-a236-4865-b2a6-c36cd61c479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:15.166877 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:15.235627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030ee99-a236-4865-b2a6-c36cd61c479b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:15.431073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3deeb-b410-4392-b026-afd55410ed62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:15.431703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3deeb-b410-4392-b026-afd55410ed62 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:15.431984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3deeb-b410-4392-b026-afd55410ed62 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:15.432257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3deeb-b410-4392-b026-afd55410ed62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:15.433941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-64b3deeb-b410-4392-b026-afd55410ed62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:15.544170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:15.569786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3deeb-b410-4392-b026-afd55410ed62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:15.571797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3deeb-b410-4392-b026-afd55410ed62 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:15.597266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 681/1406] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:18.436277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376c695-8b53-493f-9e99-3df84eeb7c94 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:18.436860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376c695-8b53-493f-9e99-3df84eeb7c94 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:18.436860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376c695-8b53-493f-9e99-3df84eeb7c94 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:18.438413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 726/1407] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:18.445241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e7c3-836b-40bb-bdfa-2668012e41ed None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:18.446321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e7c3-836b-40bb-bdfa-2668012e41ed None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:18.447322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1e7c3-836b-40bb-bdfa-2668012e41ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:18.541105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5fe1e7c3-836b-40bb-bdfa-2668012e41ed None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:18.542415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5fe1e7c3-836b-40bb-bdfa-2668012e41ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:18.661521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 682/1408] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:18.981821 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376c695-8b53-493f-9e99-3df84eeb7c94 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:18.983727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0376c695-8b53-493f-9e99-3df84eeb7c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:19.054787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:19.183542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376c695-8b53-493f-9e99-3df84eeb7c94 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:19.320858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85546585-bff2-42da-be79-e33e0ce45c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:19.321816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546585-bff2-42da-be79-e33e0ce45c6a service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:19.322097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546585-bff2-42da-be79-e33e0ce45c6a service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:19.322366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546585-bff2-42da-be79-e33e0ce45c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:19.323998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-85546585-bff2-42da-be79-e33e0ce45c6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:19.335590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:19.434848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85546585-bff2-42da-be79-e33e0ce45c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:19.436721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85546585-bff2-42da-be79-e33e0ce45c6a service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:19.456293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 727/1409] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:28.660057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=77 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:29.453878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=41 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:34.100254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084b62-b465-4fd7-8808-0610671443be None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:34.100905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084b62-b465-4fd7-8808-0610671443be None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:34.100905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084b62-b465-4fd7-8808-0610671443be None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:34.102363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 683/1410] 10.222.0.30 () {54 vars in 918 bytes} [Tue Oct 4 12:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:42:34.107856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dddc1-7396-40f6-9a37-16fc6e87a6d4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:34.108490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dddc1-7396-40f6-9a37-16fc6e87a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:34.108490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dddc1-7396-40f6-9a37-16fc6e87a6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:34.191947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-935dddc1-7396-40f6-9a37-16fc6e87a6d4 None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:34.193066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-935dddc1-7396-40f6-9a37-16fc6e87a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:34.303805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 728/1411] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Oct 4 12:42:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:42:34.319062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879722-8ec1-47e3-8e1e-5c4317b61269 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:34.319361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879722-8ec1-47e3-8e1e-5c4317b61269 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:34.319634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879722-8ec1-47e3-8e1e-5c4317b61269 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:34.321580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 684/1412] 10.222.0.30 () {54 vars in 918 bytes} [Tue Oct 4 12:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:34.326680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f44bf-1a6c-4cc5-8ab4-9ca799ad4ad7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:34.326965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f44bf-1a6c-4cc5-8ab4-9ca799ad4ad7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:34.327241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f44bf-1a6c-4cc5-8ab4-9ca799ad4ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:34.418236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:34.422428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f80f44bf-1a6c-4cc5-8ab4-9ca799ad4ad7 None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:34.424583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f80f44bf-1a6c-4cc5-8ab4-9ca799ad4ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:34.570639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 729/1413] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Oct 4 12:42:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:37.228929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65b87-6ddf-4729-a6d1-4e9cf52bca19 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:37.229690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65b87-6ddf-4729-a6d1-4e9cf52bca19 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:37.229690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65b87-6ddf-4729-a6d1-4e9cf52bca19 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:37.230891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 685/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:37.236296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00deb3b-0474-4da0-b2cb-ef009f3cd171 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:37.236783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00deb3b-0474-4da0-b2cb-ef009f3cd171 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:37.236894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00deb3b-0474-4da0-b2cb-ef009f3cd171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:37.345891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b00deb3b-0474-4da0-b2cb-ef009f3cd171 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:37.347745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b00deb3b-0474-4da0-b2cb-ef009f3cd171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:37.408672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:37.454732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 730/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:37.750944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d65b87-6ddf-4729-a6d1-4e9cf52bca19 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:37.752544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-10d65b87-6ddf-4729-a6d1-4e9cf52bca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:37.907260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d65b87-6ddf-4729-a6d1-4e9cf52bca19 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:37.987170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:38.034777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fe122-9352-4c3d-a73e-de4b5a6b3fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:38.035400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fe122-9352-4c3d-a73e-de4b5a6b3fcb service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:38.035683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fe122-9352-4c3d-a73e-de4b5a6b3fcb service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:38.035958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fe122-9352-4c3d-a73e-de4b5a6b3fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:38.037583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d83fe122-9352-4c3d-a73e-de4b5a6b3fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:38.140400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fe122-9352-4c3d-a73e-de4b5a6b3fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:38.142143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fe122-9352-4c3d-a73e-de4b5a6b3fcb service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:38.164046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 686/1416] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:39.346909 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c82d-b65e-4071-ab50-792ee3541e54 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:39.347497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c82d-b65e-4071-ab50-792ee3541e54 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:39.347497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c82d-b65e-4071-ab50-792ee3541e54 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:39.348891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 731/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:39.356105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224687a-568d-41d7-bc0c-ca4c0c879148 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:39.356646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224687a-568d-41d7-bc0c-ca4c0c879148 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:39.356742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224687a-568d-41d7-bc0c-ca4c0c879148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:39.436854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f224687a-568d-41d7-bc0c-ca4c0c879148 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:39.438100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f224687a-568d-41d7-bc0c-ca4c0c879148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:39.465264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:39.534985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 687/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:39.688319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4c82d-b65e-4071-ab50-792ee3541e54 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:39.689949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f4c4c82d-b65e-4071-ab50-792ee3541e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:39.833587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4c82d-b65e-4071-ab50-792ee3541e54 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:39.873615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:39.947592 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466163d-b94e-424f-b2cd-6fc6212103d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:39.948126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466163d-b94e-424f-b2cd-6fc6212103d1 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:39.948407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466163d-b94e-424f-b2cd-6fc6212103d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:39.948681 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466163d-b94e-424f-b2cd-6fc6212103d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:39.950314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5466163d-b94e-424f-b2cd-6fc6212103d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:40.046875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466163d-b94e-424f-b2cd-6fc6212103d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:40.048500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466163d-b94e-424f-b2cd-6fc6212103d1 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:40.066996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 732/1419] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:41.241742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07251d0-22e0-4cc5-ac85-fb3685e3b390 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:41.242616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07251d0-22e0-4cc5-ac85-fb3685e3b390 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:41.242616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07251d0-22e0-4cc5-ac85-fb3685e3b390 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:41.243698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 688/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:42:41.250538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297fdf-3494-40ad-b965-cb61beec3e12 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:41.251037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297fdf-3494-40ad-b965-cb61beec3e12 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:41.251274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297fdf-3494-40ad-b965-cb61beec3e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:41.313287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:41.338486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-04297fdf-3494-40ad-b965-cb61beec3e12 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:41.339732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-04297fdf-3494-40ad-b965-cb61beec3e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:41.448362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 733/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:41.603768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07251d0-22e0-4cc5-ac85-fb3685e3b390 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:41.605300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c07251d0-22e0-4cc5-ac85-fb3685e3b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:41.758785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07251d0-22e0-4cc5-ac85-fb3685e3b390 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:41.771270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:41.887137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e55f-b24f-4f33-af05-e87c228464a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:41.887660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e55f-b24f-4f33-af05-e87c228464a7 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:41.887940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e55f-b24f-4f33-af05-e87c228464a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:41.888214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e55f-b24f-4f33-af05-e87c228464a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:41.889869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3465e55f-b24f-4f33-af05-e87c228464a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:41.982581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465e55f-b24f-4f33-af05-e87c228464a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:41.984219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465e55f-b24f-4f33-af05-e87c228464a7 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:42.003397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 689/1422] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:43.139761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e085-b87b-43b4-acef-be8557d38a19 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:43.140377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e085-b87b-43b4-acef-be8557d38a19 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:43.140377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950e085-b87b-43b4-acef-be8557d38a19 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:43.141697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 734/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:42:43.148614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469e67e-6d7a-4aa3-b3cb-1ef6a7f1480f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:43.149548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469e67e-6d7a-4aa3-b3cb-1ef6a7f1480f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:43.149548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469e67e-6d7a-4aa3-b3cb-1ef6a7f1480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:43.170483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:43.232533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6469e67e-6d7a-4aa3-b3cb-1ef6a7f1480f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:43.233797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6469e67e-6d7a-4aa3-b3cb-1ef6a7f1480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:43.353240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 690/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:42:43.516105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950e085-b87b-43b4-acef-be8557d38a19 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:43.517701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e950e085-b87b-43b4-acef-be8557d38a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:43.629467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:43.667969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950e085-b87b-43b4-acef-be8557d38a19 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:43.784666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e6f3-f630-45ca-a588-97f3de2c4e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:43.785273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e6f3-f630-45ca-a588-97f3de2c4e94 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:43.785561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e6f3-f630-45ca-a588-97f3de2c4e94 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:43.785880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e6f3-f630-45ca-a588-97f3de2c4e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:43.787497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0d89e6f3-f630-45ca-a588-97f3de2c4e94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:43.868931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:43.884657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e6f3-f630-45ca-a588-97f3de2c4e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:43.886329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e6f3-f630-45ca-a588-97f3de2c4e94 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:43.905021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 735/1425] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:45.021612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff83120-a099-488a-b6b7-ac7260c2a6ce None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:45.022159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff83120-a099-488a-b6b7-ac7260c2a6ce None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:45.022159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff83120-a099-488a-b6b7-ac7260c2a6ce None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:45.023523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 691/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:45.030602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425a8c-4ec9-447b-9ca6-1af56321d6a1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:45.031049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425a8c-4ec9-447b-9ca6-1af56321d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:45.031158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1425a8c-4ec9-447b-9ca6-1af56321d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:45.108292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e1425a8c-4ec9-447b-9ca6-1af56321d6a1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:45.109543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e1425a8c-4ec9-447b-9ca6-1af56321d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:45.220879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 736/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:45.371692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff83120-a099-488a-b6b7-ac7260c2a6ce None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:45.373373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6ff83120-a099-488a-b6b7-ac7260c2a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:45.460985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:45.523494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff83120-a099-488a-b6b7-ac7260c2a6ce None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:45.644430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939829d-0bec-4f0f-b7c3-df726042132d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:45.644949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939829d-0bec-4f0f-b7c3-df726042132d service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:45.645222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939829d-0bec-4f0f-b7c3-df726042132d service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:45.645493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939829d-0bec-4f0f-b7c3-df726042132d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:45.647114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2939829d-0bec-4f0f-b7c3-df726042132d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:45.813052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:45.855865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939829d-0bec-4f0f-b7c3-df726042132d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:45.857491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939829d-0bec-4f0f-b7c3-df726042132d service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:45.878492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 692/1428] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:46.982041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79fd7-b424-448e-a842-207a21b183f9 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:46.982614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79fd7-b424-448e-a842-207a21b183f9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:46.982614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d79fd7-b424-448e-a842-207a21b183f9 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:46.983954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 737/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:46.991338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850909-70b2-4d5c-993d-7497fedb49f4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:46.991911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850909-70b2-4d5c-993d-7497fedb49f4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:46.991911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850909-70b2-4d5c-993d-7497fedb49f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:47.076358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0a850909-70b2-4d5c-993d-7497fedb49f4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:47.077585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0a850909-70b2-4d5c-993d-7497fedb49f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:47.176813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 693/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:47.329088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d79fd7-b424-448e-a842-207a21b183f9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:47.330598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a0d79fd7-b424-448e-a842-207a21b183f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:47.380562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:47.484540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d79fd7-b424-448e-a842-207a21b183f9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:47.597709 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c795b5a-c773-49ad-9c22-4cc98cf17982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:47.598246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c795b5a-c773-49ad-9c22-4cc98cf17982 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:47.598527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c795b5a-c773-49ad-9c22-4cc98cf17982 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:47.598800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c795b5a-c773-49ad-9c22-4cc98cf17982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:47.600414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5c795b5a-c773-49ad-9c22-4cc98cf17982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:47.607515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:47.811001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c795b5a-c773-49ad-9c22-4cc98cf17982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:47.812657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c795b5a-c773-49ad-9c22-4cc98cf17982 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:47.831005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 738/1431] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:48.894520 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48134267-5851-48d6-97ce-d8f8e3cea78d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:48.895098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48134267-5851-48d6-97ce-d8f8e3cea78d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:48.895098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48134267-5851-48d6-97ce-d8f8e3cea78d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:48.896436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 694/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:48.903196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57dee4-de11-4b72-a186-5d8fdb6bf31a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:48.903635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57dee4-de11-4b72-a186-5d8fdb6bf31a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:48.903741 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57dee4-de11-4b72-a186-5d8fdb6bf31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:48.987239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2d57dee4-de11-4b72-a186-5d8fdb6bf31a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:48.988462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2d57dee4-de11-4b72-a186-5d8fdb6bf31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:49.057582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:49.087748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 739/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:49.238991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48134267-5851-48d6-97ce-d8f8e3cea78d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:49.240453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-48134267-5851-48d6-97ce-d8f8e3cea78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:49.259739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:49.388189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48134267-5851-48d6-97ce-d8f8e3cea78d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:49.477753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:49.503857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00881ac3-2c8f-4b8e-b186-2d944087fdcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:49.504358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881ac3-2c8f-4b8e-b186-2d944087fdcb service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:49.504639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881ac3-2c8f-4b8e-b186-2d944087fdcb service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:49.504915 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881ac3-2c8f-4b8e-b186-2d944087fdcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:49.506541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-00881ac3-2c8f-4b8e-b186-2d944087fdcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:49.597706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00881ac3-2c8f-4b8e-b186-2d944087fdcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:49.599329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00881ac3-2c8f-4b8e-b186-2d944087fdcb service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:49.617171 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 695/1434] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:50.696072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e280b6-57e5-4291-95c5-2e23448425b4 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:50.696646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e280b6-57e5-4291-95c5-2e23448425b4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:50.696646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e280b6-57e5-4291-95c5-2e23448425b4 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:50.697925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 740/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:50.704351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea1037-96c9-4f46-aca3-d28ae1cbb0b0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:50.704799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea1037-96c9-4f46-aca3-d28ae1cbb0b0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:50.704909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea1037-96c9-4f46-aca3-d28ae1cbb0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:50.782070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-adea1037-96c9-4f46-aca3-d28ae1cbb0b0 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:50.783297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-adea1037-96c9-4f46-aca3-d28ae1cbb0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:50.825272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:50.880874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 696/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:51.032676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e280b6-57e5-4291-95c5-2e23448425b4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:51.034188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-05e280b6-57e5-4291-95c5-2e23448425b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:51.198009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e280b6-57e5-4291-95c5-2e23448425b4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:51.257276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:51.318523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59d896-6dc5-4060-8fa5-56a6d998f6ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:51.319047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d896-6dc5-4060-8fa5-56a6d998f6ca service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:51.319370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d896-6dc5-4060-8fa5-56a6d998f6ca service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:51.319605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d896-6dc5-4060-8fa5-56a6d998f6ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:51.321914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dc59d896-6dc5-4060-8fa5-56a6d998f6ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:51.412882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59d896-6dc5-4060-8fa5-56a6d998f6ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:51.414623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59d896-6dc5-4060-8fa5-56a6d998f6ca service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:51.433326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 741/1437] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:42:52.513626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7680d-f2da-4a95-b55e-fd16238baa00 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:52.514235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7680d-f2da-4a95-b55e-fd16238baa00 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:52.514235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7680d-f2da-4a95-b55e-fd16238baa00 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:52.515543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 697/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:52.522050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118b79-8e0d-47ec-b220-b5f9cfe3d4ac None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:52.522548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118b79-8e0d-47ec-b220-b5f9cfe3d4ac None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:52.522655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a118b79-8e0d-47ec-b220-b5f9cfe3d4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:52.599410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5a118b79-8e0d-47ec-b220-b5f9cfe3d4ac None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:52.600623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5a118b79-8e0d-47ec-b220-b5f9cfe3d4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:52.602802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:52.704098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 742/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:52.852155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7680d-f2da-4a95-b55e-fd16238baa00 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:52.853722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8eb7680d-f2da-4a95-b55e-fd16238baa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:53.004116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7680d-f2da-4a95-b55e-fd16238baa00 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:53.033132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:53.122439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc0db3-6b83-410e-85f7-6a5886fda734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:53.123052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0db3-6b83-410e-85f7-6a5886fda734 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:53.123326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0db3-6b83-410e-85f7-6a5886fda734 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:53.123595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0db3-6b83-410e-85f7-6a5886fda734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:53.125185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9dcc0db3-6b83-410e-85f7-6a5886fda734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:53.218490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc0db3-6b83-410e-85f7-6a5886fda734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:53.220102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc0db3-6b83-410e-85f7-6a5886fda734 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:53.237932 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 698/1440] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:55.356527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1823b-0ff5-498d-ad2b-e97662ed508f None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:55.357114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1823b-0ff5-498d-ad2b-e97662ed508f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:55.357114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1823b-0ff5-498d-ad2b-e97662ed508f None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:55.358512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 743/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:55.364150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432550ed-f82f-43c9-a110-2c8bfd362a9a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:55.364648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432550ed-f82f-43c9-a110-2c8bfd362a9a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:55.364756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432550ed-f82f-43c9-a110-2c8bfd362a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:55.409880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:55.438756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-432550ed-f82f-43c9-a110-2c8bfd362a9a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:55.439984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-432550ed-f82f-43c9-a110-2c8bfd362a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:55.537453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 699/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:55.832625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1823b-0ff5-498d-ad2b-e97662ed508f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:55.834201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d4d1823b-0ff5-498d-ad2b-e97662ed508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:55.939851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1823b-0ff5-498d-ad2b-e97662ed508f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:55.972448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:56.016439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef432806-e185-4781-8fee-d3489919c938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:56.017034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432806-e185-4781-8fee-d3489919c938 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:56.017310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432806-e185-4781-8fee-d3489919c938 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:56.017578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef432806-e185-4781-8fee-d3489919c938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:56.019200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ef432806-e185-4781-8fee-d3489919c938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:56.130600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef432806-e185-4781-8fee-d3489919c938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:56.132045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef432806-e185-4781-8fee-d3489919c938 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:56.150628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 744/1443] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:42:58.496533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf771-364f-47f9-8d8b-8fb65a7a7db8 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:58.497079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf771-364f-47f9-8d8b-8fb65a7a7db8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:58.497079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabf771-364f-47f9-8d8b-8fb65a7a7db8 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:58.498495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 700/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:42:58.504431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ae59-306b-40e4-9ed0-1f8a2348bcab None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:58.505005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ae59-306b-40e4-9ed0-1f8a2348bcab None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:58.505005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7ae59-306b-40e4-9ed0-1f8a2348bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:58.571669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-19a7ae59-306b-40e4-9ed0-1f8a2348bcab None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:42:58.572891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-19a7ae59-306b-40e4-9ed0-1f8a2348bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:58.585540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:58.672772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 745/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:42:58.958209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabf771-364f-47f9-8d8b-8fb65a7a7db8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:42:58.959885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2eabf771-364f-47f9-8d8b-8fb65a7a7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:59.068125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabf771-364f-47f9-8d8b-8fb65a7a7db8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:42:59.081720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:42:59.150355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbb9f3-20b8-4ce3-ae1b-079b2524686c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:42:59.150966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb9f3-20b8-4ce3-ae1b-079b2524686c service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:42:59.151248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb9f3-20b8-4ce3-ae1b-079b2524686c service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:42:59.151517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbb9f3-20b8-4ce3-ae1b-079b2524686c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:42:59.153326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-10dbb9f3-20b8-4ce3-ae1b-079b2524686c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:42:59.267243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb9f3-20b8-4ce3-ae1b-079b2524686c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:42:59.268625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbb9f3-20b8-4ce3-ae1b-079b2524686c service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:42:59.287891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 701/1446] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:01.812602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7aebc-1846-4afb-9eb8-54199373f0c4 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:01.813152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7aebc-1846-4afb-9eb8-54199373f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:01.813152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7aebc-1846-4afb-9eb8-54199373f0c4 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:01.814471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 746/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:01.819722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445a1d9-b588-4120-8376-e1232e185ce4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:01.820817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445a1d9-b588-4120-8376-e1232e185ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:01.820947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445a1d9-b588-4120-8376-e1232e185ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:01.868265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:01.887395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9445a1d9-b588-4120-8376-e1232e185ce4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:01.888611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9445a1d9-b588-4120-8376-e1232e185ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:01.984417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 702/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:02.270897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7aebc-1846-4afb-9eb8-54199373f0c4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:02.272470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bcb7aebc-1846-4afb-9eb8-54199373f0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:02.383183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7aebc-1846-4afb-9eb8-54199373f0c4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:02.424888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:02.459782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681910b-0242-4cf1-b57d-d92cf2e44da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:02.460402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681910b-0242-4cf1-b57d-d92cf2e44da3 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:02.460735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681910b-0242-4cf1-b57d-d92cf2e44da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:02.461610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681910b-0242-4cf1-b57d-d92cf2e44da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:02.463240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1681910b-0242-4cf1-b57d-d92cf2e44da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:02.572663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681910b-0242-4cf1-b57d-d92cf2e44da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:02.574048 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681910b-0242-4cf1-b57d-d92cf2e44da3 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:02.592147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 747/1449] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:04.941497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9341-a3cd-4754-a34c-755dfdd8c870 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:04.942114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9341-a3cd-4754-a34c-755dfdd8c870 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:04.942114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9341-a3cd-4754-a34c-755dfdd8c870 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:04.943441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 703/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:43:04.949511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec6a9e-92d3-42fd-ab84-e95ee6604cca None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:04.950003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec6a9e-92d3-42fd-ab84-e95ee6604cca None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:04.950117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec6a9e-92d3-42fd-ab84-e95ee6604cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:05.017242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e6ec6a9e-92d3-42fd-ab84-e95ee6604cca None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:05.018515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e6ec6a9e-92d3-42fd-ab84-e95ee6604cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:05.039578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:05.115318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 748/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:05.406686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c9341-a3cd-4754-a34c-755dfdd8c870 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:05.408314 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b75c9341-a3cd-4754-a34c-755dfdd8c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:05.515241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c9341-a3cd-4754-a34c-755dfdd8c870 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:05.540457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:05.597719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd64f0a-e0be-40b5-9cbe-c98e2b6d694c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:05.598350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64f0a-e0be-40b5-9cbe-c98e2b6d694c service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:05.598625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64f0a-e0be-40b5-9cbe-c98e2b6d694c service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:05.598893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64f0a-e0be-40b5-9cbe-c98e2b6d694c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:05.600467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1fd64f0a-e0be-40b5-9cbe-c98e2b6d694c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:05.708450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd64f0a-e0be-40b5-9cbe-c98e2b6d694c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:05.709935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd64f0a-e0be-40b5-9cbe-c98e2b6d694c service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:05.728683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 704/1452] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:43:07.969863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4956f-ceb4-4ea3-a393-bb821e8aa61e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:07.970424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4956f-ceb4-4ea3-a393-bb821e8aa61e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:07.970424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4956f-ceb4-4ea3-a393-bb821e8aa61e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:07.971843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 749/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:07.978523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f959b9-63b0-47f2-97b8-c1b87e7b0c28 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:07.979096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f959b9-63b0-47f2-97b8-c1b87e7b0c28 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:07.979096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f959b9-63b0-47f2-97b8-c1b87e7b0c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:08.047479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:08.051447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c3f959b9-63b0-47f2-97b8-c1b87e7b0c28 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:08.053074 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c3f959b9-63b0-47f2-97b8-c1b87e7b0c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:08.154191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 705/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:08.438175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4956f-ceb4-4ea3-a393-bb821e8aa61e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:08.440853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f9a4956f-ceb4-4ea3-a393-bb821e8aa61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:08.552885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4956f-ceb4-4ea3-a393-bb821e8aa61e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:08.604725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:08.629408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656da2a-9e26-49d6-a327-8ab11f75112a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:08.630049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656da2a-9e26-49d6-a327-8ab11f75112a service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:08.630330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656da2a-9e26-49d6-a327-8ab11f75112a service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:08.630603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656da2a-9e26-49d6-a327-8ab11f75112a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:08.632211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f656da2a-9e26-49d6-a327-8ab11f75112a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:08.744933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656da2a-9e26-49d6-a327-8ab11f75112a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:08.746338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656da2a-9e26-49d6-a327-8ab11f75112a service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:08.764443 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 750/1455] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:11.013008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03fd-ad6d-4d95-9bc6-8f906438c57e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:11.013584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03fd-ad6d-4d95-9bc6-8f906438c57e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:11.013584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a03fd-ad6d-4d95-9bc6-8f906438c57e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:11.014938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 706/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:11.020562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257490-1c04-43b4-97af-9b6b2718fbe9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:11.021004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257490-1c04-43b4-97af-9b6b2718fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:11.021195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07257490-1c04-43b4-97af-9b6b2718fbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:11.090225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-07257490-1c04-43b4-97af-9b6b2718fbe9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:11.091457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-07257490-1c04-43b4-97af-9b6b2718fbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:11.126601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:11.208164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 751/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:11.511243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a03fd-ad6d-4d95-9bc6-8f906438c57e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:11.512806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d57a03fd-ad6d-4d95-9bc6-8f906438c57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:11.625944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a03fd-ad6d-4d95-9bc6-8f906438c57e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:11.657510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:11.706573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf1dc0-b3a2-4c02-9985-d106459b281e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:11.707093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf1dc0-b3a2-4c02-9985-d106459b281e service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:11.707375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf1dc0-b3a2-4c02-9985-d106459b281e service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:11.707650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf1dc0-b3a2-4c02-9985-d106459b281e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:11.709282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1ecf1dc0-b3a2-4c02-9985-d106459b281e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:11.827464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf1dc0-b3a2-4c02-9985-d106459b281e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:11.828926 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf1dc0-b3a2-4c02-9985-d106459b281e service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:11.847478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 707/1458] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:14.090356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623ea8-d21a-4455-a1ea-e322bcd283bd None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:14.090897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623ea8-d21a-4455-a1ea-e322bcd283bd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:14.090897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623ea8-d21a-4455-a1ea-e322bcd283bd None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:14.092254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 752/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:14.097765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae704-833a-46c8-93f6-5ba4a9a6031a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:14.098242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae704-833a-46c8-93f6-5ba4a9a6031a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:14.098346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae704-833a-46c8-93f6-5ba4a9a6031a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:14.167784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3e6ae704-833a-46c8-93f6-5ba4a9a6031a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:14.168902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3e6ae704-833a-46c8-93f6-5ba4a9a6031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:14.177647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:14.269829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 708/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:14.563473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7623ea8-d21a-4455-a1ea-e322bcd283bd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:14.565048 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e7623ea8-d21a-4455-a1ea-e322bcd283bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:14.671451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7623ea8-d21a-4455-a1ea-e322bcd283bd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:14.727722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:14.746341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc78342-cf4c-4649-a95d-c22faa7fa7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:14.746954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78342-cf4c-4649-a95d-c22faa7fa7ef service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:14.747234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78342-cf4c-4649-a95d-c22faa7fa7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:14.747504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78342-cf4c-4649-a95d-c22faa7fa7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:14.749133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fdc78342-cf4c-4649-a95d-c22faa7fa7ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:14.862667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc78342-cf4c-4649-a95d-c22faa7fa7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:14.864105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc78342-cf4c-4649-a95d-c22faa7fa7ef service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:14.882491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 753/1461] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:17.098510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076416e-6224-4836-aead-bf47821f9a34 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:17.099099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076416e-6224-4836-aead-bf47821f9a34 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:17.099099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076416e-6224-4836-aead-bf47821f9a34 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:17.100407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 709/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:17.106458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735b162-4d39-486b-86bd-c50b22417843 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:17.106896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735b162-4d39-486b-86bd-c50b22417843 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:17.107012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735b162-4d39-486b-86bd-c50b22417843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:17.175756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1735b162-4d39-486b-86bd-c50b22417843 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:17.176975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1735b162-4d39-486b-86bd-c50b22417843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:17.216525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:17.276819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 754/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:17.565209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076416e-6224-4836-aead-bf47821f9a34 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:17.566820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9076416e-6224-4836-aead-bf47821f9a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:17.674021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076416e-6224-4836-aead-bf47821f9a34 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:17.712332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:17.748356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488145b5-f802-4727-9a3c-93d1d861f44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:17.748962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488145b5-f802-4727-9a3c-93d1d861f44a service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:17.749236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488145b5-f802-4727-9a3c-93d1d861f44a service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:17.749501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488145b5-f802-4727-9a3c-93d1d861f44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:17.751111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-488145b5-f802-4727-9a3c-93d1d861f44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:17.860933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488145b5-f802-4727-9a3c-93d1d861f44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:17.862476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488145b5-f802-4727-9a3c-93d1d861f44a service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:17.884586 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 710/1464] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:20.081341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854d4f-a5d8-45b0-a353-95b66e1a90de None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:20.081970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854d4f-a5d8-45b0-a353-95b66e1a90de None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:20.081970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854d4f-a5d8-45b0-a353-95b66e1a90de None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:20.083339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 755/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:20.090114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491e281-20ea-4df7-86e3-920d779d0ce3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:20.090602 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491e281-20ea-4df7-86e3-920d779d0ce3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:20.090698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491e281-20ea-4df7-86e3-920d779d0ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:20.159239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e491e281-20ea-4df7-86e3-920d779d0ce3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:20.160475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e491e281-20ea-4df7-86e3-920d779d0ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:20.182036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:20.264275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 711/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:20.547011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854d4f-a5d8-45b0-a353-95b66e1a90de None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:20.548606 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-17854d4f-a5d8-45b0-a353-95b66e1a90de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:20.676797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854d4f-a5d8-45b0-a353-95b66e1a90de None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:20.745969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:20.753384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188eb21-a901-4125-a55a-8cc9a79fd768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:20.754039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188eb21-a901-4125-a55a-8cc9a79fd768 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:20.754323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188eb21-a901-4125-a55a-8cc9a79fd768 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:20.754595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188eb21-a901-4125-a55a-8cc9a79fd768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:20.756222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7188eb21-a901-4125-a55a-8cc9a79fd768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:20.882738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188eb21-a901-4125-a55a-8cc9a79fd768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:20.884194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188eb21-a901-4125-a55a-8cc9a79fd768 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:20.903296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 756/1467] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:23.119614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87516d9-0988-4aa7-baed-7d24205f591a None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:23.120217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87516d9-0988-4aa7-baed-7d24205f591a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:23.120217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87516d9-0988-4aa7-baed-7d24205f591a None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:23.121658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 712/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:23.127250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a016-cdbd-40cd-b399-0e1b3776390a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:23.127829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a016-cdbd-40cd-b399-0e1b3776390a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:23.127829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a016-cdbd-40cd-b399-0e1b3776390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:23.199790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3f51a016-cdbd-40cd-b399-0e1b3776390a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:23.201029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3f51a016-cdbd-40cd-b399-0e1b3776390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:23.250703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:23.302942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 757/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:23.592942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87516d9-0988-4aa7-baed-7d24205f591a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:23.594598 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c87516d9-0988-4aa7-baed-7d24205f591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:23.709914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87516d9-0988-4aa7-baed-7d24205f591a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:23.763141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:23.791261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de1b59-f45c-402d-8c0c-0ec7d3446a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:23.791876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de1b59-f45c-402d-8c0c-0ec7d3446a18 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:23.792157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de1b59-f45c-402d-8c0c-0ec7d3446a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:23.792431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de1b59-f45c-402d-8c0c-0ec7d3446a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:23.794118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b4de1b59-f45c-402d-8c0c-0ec7d3446a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:23.904532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de1b59-f45c-402d-8c0c-0ec7d3446a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:23.906114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de1b59-f45c-402d-8c0c-0ec7d3446a18 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:23.926260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 713/1470] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:33.301474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=22 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:33.923852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=66 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:44.079982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e444-dfb0-484c-a4a4-89d39bb629ff None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:44.080549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e444-dfb0-484c-a4a4-89d39bb629ff None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:44.080549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e444-dfb0-484c-a4a4-89d39bb629ff None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:44.082265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 758/1471] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:44.088958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b781d2f-13d2-478a-a58b-178de1fba81e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:44.089465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b781d2f-13d2-478a-a58b-178de1fba81e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:44.089574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b781d2f-13d2-478a-a58b-178de1fba81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:44.157904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3b781d2f-13d2-478a-a58b-178de1fba81e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:44.159122 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3b781d2f-13d2-478a-a58b-178de1fba81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:44.258739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 714/1472] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:44.559428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5a9a-e615-4d4c-80d9-f6f94d2ae8a3 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:44.559713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5a9a-e615-4d4c-80d9-f6f94d2ae8a3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:44.559992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5a9a-e615-4d4c-80d9-f6f94d2ae8a3 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:44.561405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 759/1473] 10.222.0.30 () {54 vars in 962 bytes} [Tue Oct 4 12:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:44.566260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bbfa8-abdd-416e-8564-60382915d854 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:44.566551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bbfa8-abdd-416e-8564-60382915d854 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:44.566826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bbfa8-abdd-416e-8564-60382915d854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:44.641517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-804bbfa8-abdd-416e-8564-60382915d854 None None] MFA Rules not processed for user `cdb8a57a383c475caff51c3d6d5c6a47`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:44.642764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-804bbfa8-abdd-416e-8564-60382915d854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:44.664273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:44.719317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 715/1474] 10.222.0.30 () {58 vars in 1059 bytes} [Tue Oct 4 12:43:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:44.727752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5a9a-e615-4d4c-80d9-f6f94d2ae8a3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:44.729282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c91e5a9a-e615-4d4c-80d9-f6f94d2ae8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:44.829995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5a9a-e615-4d4c-80d9-f6f94d2ae8a3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:44.907505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1080e-2158-438b-8f31-8b626105560e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdb8a57a383c475caff51c3d6d5c6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:44.908132 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1080e-2158-438b-8f31-8b626105560e service glance] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:44.908410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1080e-2158-438b-8f31-8b626105560e service glance] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:44.908682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1080e-2158-438b-8f31-8b626105560e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:44.910399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-10d1080e-2158-438b-8f31-8b626105560e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:44.966579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:45.021820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1080e-2158-438b-8f31-8b626105560e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:45.024075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1080e-2158-438b-8f31-8b626105560e service glance] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:45.043448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 760/1475] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:47.302988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae646-b255-4eb9-ac53-1284b483e077 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:47.303606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae646-b255-4eb9-ac53-1284b483e077 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:47.303606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae646-b255-4eb9-ac53-1284b483e077 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:47.305032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 716/1476] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:47.310422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b7f6-4767-4e67-9f40-96c3cbdedc49 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:47.310897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b7f6-4767-4e67-9f40-96c3cbdedc49 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:47.310996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b7f6-4767-4e67-9f40-96c3cbdedc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:47.377213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-afc5b7f6-4767-4e67-9f40-96c3cbdedc49 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:47.378452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-afc5b7f6-4767-4e67-9f40-96c3cbdedc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:47.474850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 761/1477] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:43:47.760454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ae646-b255-4eb9-ac53-1284b483e077 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:47.762035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-503ae646-b255-4eb9-ac53-1284b483e077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:47.886737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ae646-b255-4eb9-ac53-1284b483e077 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:47.939761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:47.985395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f2a9a-c981-4af2-bc93-37030f9a2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:47.986042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f2a9a-c981-4af2-bc93-37030f9a2750 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:47.986321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f2a9a-c981-4af2-bc93-37030f9a2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:47.986591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f2a9a-c981-4af2-bc93-37030f9a2750 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:47.987231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f2a9a-c981-4af2-bc93-37030f9a2750 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:47.988961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-8b8f2a9a-c981-4af2-bc93-37030f9a2750 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:43:47.988961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: warnings.warn(msg) Oct 04 12:43:47.988961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: Oct 04 12:43:47.990153 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f2a9a-c981-4af2-bc93-37030f9a2750 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:48.010125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 717/1478] 10.222.0.30 () {56 vars in 1108 bytes} [Tue Oct 4 12:43:47 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:43:50.209383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82e9f-9b33-4618-9ba3-82441b32ea49 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:50.210486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82e9f-9b33-4618-9ba3-82441b32ea49 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:50.210486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82e9f-9b33-4618-9ba3-82441b32ea49 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:50.211832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 762/1479] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:50.217645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393e0d9-be1d-45c8-bae8-cdf9acd88793 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:50.218153 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393e0d9-be1d-45c8-bae8-cdf9acd88793 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:50.218290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393e0d9-be1d-45c8-bae8-cdf9acd88793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:50.285105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6393e0d9-be1d-45c8-bae8-cdf9acd88793 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:50.286366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6393e0d9-be1d-45c8-bae8-cdf9acd88793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:50.383758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 718/1480] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:43:50.678342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82e9f-9b33-4618-9ba3-82441b32ea49 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:50.679879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b5e82e9f-9b33-4618-9ba3-82441b32ea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:50.689708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:50.826192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82e9f-9b33-4618-9ba3-82441b32ea49 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:50.907280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:50.940978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc25648-6543-4e34-96d8-7efd9600567d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:50.941499 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25648-6543-4e34-96d8-7efd9600567d service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:50.941807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25648-6543-4e34-96d8-7efd9600567d service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:50.942079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc25648-6543-4e34-96d8-7efd9600567d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:50.944203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bdc25648-6543-4e34-96d8-7efd9600567d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:51.036542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc25648-6543-4e34-96d8-7efd9600567d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:51.038207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc25648-6543-4e34-96d8-7efd9600567d service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:51.055964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 763/1481] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:53.468318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36a366-6790-4cee-a301-ab561992b9d7 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:53.468851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36a366-6790-4cee-a301-ab561992b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:53.468985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36a366-6790-4cee-a301-ab561992b9d7 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:53.470290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 719/1482] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:53.476024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04099a94-a111-47e8-b16c-37320ad47c94 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:53.476488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04099a94-a111-47e8-b16c-37320ad47c94 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:53.476584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04099a94-a111-47e8-b16c-37320ad47c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:53.546898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-04099a94-a111-47e8-b16c-37320ad47c94 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:53.548121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-04099a94-a111-47e8-b16c-37320ad47c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:53.594876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:53.645537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 764/1483] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:53.936276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36a366-6790-4cee-a301-ab561992b9d7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:53.937863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2d36a366-6790-4cee-a301-ab561992b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:53.961317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:54.044390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36a366-6790-4cee-a301-ab561992b9d7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:54.120589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4828e1-4e9c-449f-b7b5-4c7269b7185a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:54.121193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4828e1-4e9c-449f-b7b5-4c7269b7185a service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:54.121471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4828e1-4e9c-449f-b7b5-4c7269b7185a service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:54.121776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4828e1-4e9c-449f-b7b5-4c7269b7185a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:54.123676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bf4828e1-4e9c-449f-b7b5-4c7269b7185a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:54.198649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:54.237123 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4828e1-4e9c-449f-b7b5-4c7269b7185a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:54.238650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4828e1-4e9c-449f-b7b5-4c7269b7185a service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:54.258011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 720/1484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:56.470858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8dcf-e2cd-4cc2-b466-c8814b9f87d2 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:56.471425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8dcf-e2cd-4cc2-b466-c8814b9f87d2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:56.471425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b8dcf-e2cd-4cc2-b466-c8814b9f87d2 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:56.472793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 765/1485] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:56.478842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766ced-8b55-4a57-b8f2-120a58b2bf04 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:56.479340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766ced-8b55-4a57-b8f2-120a58b2bf04 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:56.479445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766ced-8b55-4a57-b8f2-120a58b2bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:56.547696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-71766ced-8b55-4a57-b8f2-120a58b2bf04 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:56.548921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-71766ced-8b55-4a57-b8f2-120a58b2bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:56.652873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 721/1486] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:43:56.941872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8dcf-e2cd-4cc2-b466-c8814b9f87d2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:43:56.943940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5b8b8dcf-e2cd-4cc2-b466-c8814b9f87d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:57.051679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b8dcf-e2cd-4cc2-b466-c8814b9f87d2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:43:57.124173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:57.125695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ab4e2-69e4-4ab7-a10f-3a467d5b420e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:43:57.126392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab4e2-69e4-4ab7-a10f-3a467d5b420e service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:57.126865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab4e2-69e4-4ab7-a10f-3a467d5b420e service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:57.127335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ab4e2-69e4-4ab7-a10f-3a467d5b420e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:57.129127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-346ab4e2-69e4-4ab7-a10f-3a467d5b420e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:57.243778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ab4e2-69e4-4ab7-a10f-3a467d5b420e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:43:57.245058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ab4e2-69e4-4ab7-a10f-3a467d5b420e service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:43:57.263567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 766/1487] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:43:59.556884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ae3a-0060-4a0d-aa9f-2505e4fd9eba None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:59.557495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ae3a-0060-4a0d-aa9f-2505e4fd9eba None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:59.557495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ae3a-0060-4a0d-aa9f-2505e4fd9eba None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:59.558866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 722/1488] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:43:59.564992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84210-c31d-4d5e-bc37-7054496afda1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:43:59.565584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84210-c31d-4d5e-bc37-7054496afda1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:43:59.565584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84210-c31d-4d5e-bc37-7054496afda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:43:59.642114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-27c84210-c31d-4d5e-bc37-7054496afda1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:43:59.643364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-27c84210-c31d-4d5e-bc37-7054496afda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:43:59.702959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:43:59.750489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 767/1489] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:44:00.048419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ae3a-0060-4a0d-aa9f-2505e4fd9eba None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:44:00.049985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-27d8ae3a-0060-4a0d-aa9f-2505e4fd9eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:44:00.087184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:44:00.154672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ae3a-0060-4a0d-aa9f-2505e4fd9eba None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:44:00.231612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4be7e-1960-417d-8ff4-e2840526662d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:44:00.232225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4be7e-1960-417d-8ff4-e2840526662d service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:44:00.232507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4be7e-1960-417d-8ff4-e2840526662d service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:44:00.232781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4be7e-1960-417d-8ff4-e2840526662d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:44:00.234464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-87f4be7e-1960-417d-8ff4-e2840526662d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:44:00.318197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:44:00.347539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4be7e-1960-417d-8ff4-e2840526662d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:44:00.348984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4be7e-1960-417d-8ff4-e2840526662d service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:44:00.367519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 723/1490] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:44:02.731850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f36b9-ea9c-4cc6-a921-6fe0af212d23 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:44:02.732374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f36b9-ea9c-4cc6-a921-6fe0af212d23 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:44:02.732374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f36b9-ea9c-4cc6-a921-6fe0af212d23 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:44:02.733710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 768/1491] 10.222.0.30 () {54 vars in 927 bytes} [Tue Oct 4 12:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:44:02.739562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2265d1-d427-421c-9eb0-bf88e5636393 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:44:02.740102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2265d1-d427-421c-9eb0-bf88e5636393 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:44:02.740102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2265d1-d427-421c-9eb0-bf88e5636393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:44:02.815856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7e2265d1-d427-421c-9eb0-bf88e5636393 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:44:02.817119 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7e2265d1-d427-421c-9eb0-bf88e5636393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:44:02.936114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 724/1492] 10.222.0.30 () {58 vars in 1024 bytes} [Tue Oct 4 12:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:44:03.234881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f36b9-ea9c-4cc6-a921-6fe0af212d23 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:44:03.236429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fa8f36b9-ea9c-4cc6-a921-6fe0af212d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:44:03.343066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f36b9-ea9c-4cc6-a921-6fe0af212d23 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:44:03.418493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85246f9c-100d-4f36-8e7b-139a60fe29f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:44:03.419084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246f9c-100d-4f36-8e7b-139a60fe29f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:44:03.419358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246f9c-100d-4f36-8e7b-139a60fe29f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:44:03.419626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246f9c-100d-4f36-8e7b-139a60fe29f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:44:03.421224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-85246f9c-100d-4f36-8e7b-139a60fe29f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:44:03.431012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:44:03.532530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246f9c-100d-4f36-8e7b-139a60fe29f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:44:03.533916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85246f9c-100d-4f36-8e7b-139a60fe29f2 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:44:03.551946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 769/1493] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:44:12.934366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=82 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:44:13.549658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=50 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:23.223389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7cd3-6a8d-4808-b758-f60980d7db86 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:23.223961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7cd3-6a8d-4808-b758-f60980d7db86 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:23.223961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7cd3-6a8d-4808-b758-f60980d7db86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:23.304533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-923a7cd3-6a8d-4808-b758-f60980d7db86 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:45:23.305778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-923a7cd3-6a8d-4808-b758-f60980d7db86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:23.405464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 725/1494] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:45:23.414315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25725-29e6-45a0-a426-2d970e4d77f4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:23.414849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25725-29e6-45a0-a426-2d970e4d77f4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:23.415033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25725-29e6-45a0-a426-2d970e4d77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:23.493976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4fc25725-29e6-45a0-a426-2d970e4d77f4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:45:23.495136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4fc25725-29e6-45a0-a426-2d970e4d77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:23.592902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 770/1495] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:45:23.598220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7cd3-6a8d-4808-b758-f60980d7db86 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:23.599907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-923a7cd3-6a8d-4808-b758-f60980d7db86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:23.613840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7cd3-6a8d-4808-b758-f60980d7db86 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:23.683380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:23.716412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:23.717031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:23.717311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:23.717585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:23.718263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:45:23.718583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:23.719641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:45:23.719641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: warnings.warn(msg) Oct 04 12:45:23.719641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: Oct 04 12:45:23.720528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:23.733378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 726/1496] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:45:23.742495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25725-29e6-45a0-a426-2d970e4d77f4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:23.751954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25725-29e6-45a0-a426-2d970e4d77f4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:23.814201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:23.848492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:23.849096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:23.849377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:23.849673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:23.850310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:23.852056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:45:23.852056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: warnings.warn(msg) Oct 04 12:45:23.852056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: Oct 04 12:45:23.853276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:23.908828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 771/1497] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:45:23 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:45:23.913747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:23.915287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:23.951611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0bd34-d37b-477d-b0d9-8811a1e264f8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:24.047110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:24.047621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:24.047894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:24.048160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:24.048790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:24.049854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:45:24.049854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: warnings.warn(msg) Oct 04 12:45:24.049854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: Oct 04 12:45:24.051232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:24.094917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 727/1498] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:45:23 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:45:24.099008 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:24.100582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:24.166730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09281795-5f90-406b-9912-e3501b9b0a5a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:24.251384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:24.262953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:24.263588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:24.263872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:24.264147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:24.264798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:24.265844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:45:24.265844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: warnings.warn(msg) Oct 04 12:45:24.265844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: Oct 04 12:45:24.266748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:24.280637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 772/1499] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:45:24.285371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:24.286928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:24.298500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685d9cd-ce77-48b0-8d6a-d06271c60d0c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:24.324165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:24.395569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758161-946d-44bd-82fa-97d0e14972b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:24.396175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758161-946d-44bd-82fa-97d0e14972b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:24.396454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758161-946d-44bd-82fa-97d0e14972b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:24.396724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758161-946d-44bd-82fa-97d0e14972b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:24.397638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce758161-946d-44bd-82fa-97d0e14972b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:24.398660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-ce758161-946d-44bd-82fa-97d0e14972b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:45:24.398660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: warnings.warn(msg) Oct 04 12:45:24.398660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: Oct 04 12:45:24.399539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce758161-946d-44bd-82fa-97d0e14972b4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:24.411871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 728/1500] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:45:24.416592 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:24.419186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:24.453777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9db8-eae4-4563-b10b-b7773213175d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:24.554616 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78be51b-ad59-4be2-b44c-d5d945582ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:24.555193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be51b-ad59-4be2-b44c-d5d945582ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:24.555466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be51b-ad59-4be2-b44c-d5d945582ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:24.555739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78be51b-ad59-4be2-b44c-d5d945582ef7 admin admin] PATH_INFO: `/v3/projects/bccbfd5e5fbb41deb775b202ea3ab986/users/254b2f1547d24325a9cfb61a7c2d4e19/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:24.578453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78be51b-ad59-4be2-b44c-d5d945582ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bccbfd5e5fbb41deb775b202ea3ab986, user_id=254b2f1547d24325a9cfb61a7c2d4e19, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:24.579493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-d78be51b-ad59-4be2-b44c-d5d945582ef7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:45:24.579493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: warnings.warn(msg) Oct 04 12:45:24.579493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: Oct 04 12:45:24.581447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78be51b-ad59-4be2-b44c-d5d945582ef7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:24.606326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 773/1501] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:45:24 2022] PUT /identity/v3/projects/bccbfd5e5fbb41deb775b202ea3ab986/users/254b2f1547d24325a9cfb61a7c2d4e19/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:45:24.619256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870950c5-c784-4d25-91b9-951b788e189a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:24.619544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870950c5-c784-4d25-91b9-951b788e189a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:24.619848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870950c5-c784-4d25-91b9-951b788e189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:24.677506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-870950c5-c784-4d25-91b9-951b788e189a None None] MFA Rules not processed for user `254b2f1547d24325a9cfb61a7c2d4e19`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:45:24.678999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-870950c5-c784-4d25-91b9-951b788e189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:24.756168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 729/1502] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:45:24.770206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f4d1-5612-42b9-9d68-685cc207b956 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:24.770496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f4d1-5612-42b9-9d68-685cc207b956 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:24.770776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f4d1-5612-42b9-9d68-685cc207b956 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:24.772123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 774/1503] 10.222.0.30 () {54 vars in 963 bytes} [Tue Oct 4 12:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:45:24.777137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167ede-0dd1-4247-8c1d-bbf1556c468b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:24.777425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167ede-0dd1-4247-8c1d-bbf1556c468b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:24.777734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167ede-0dd1-4247-8c1d-bbf1556c468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:24.808594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:24.852798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cb167ede-0dd1-4247-8c1d-bbf1556c468b None None] MFA Rules not processed for user `d75de5eca91b46daaffd3bd79b69a6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:45:24.854036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cb167ede-0dd1-4247-8c1d-bbf1556c468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:24.928929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 730/1504] 10.222.0.30 () {58 vars in 1060 bytes} [Tue Oct 4 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:45:24.939136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f4d1-5612-42b9-9d68-685cc207b956 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:24.940640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-16b7f4d1-5612-42b9-9d68-685cc207b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:24.994179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:25.050095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f4d1-5612-42b9-9d68-685cc207b956 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:25.124168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:25.124779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:25.125058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:25.125330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:25.126953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:25.231884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:25.233370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:25.236840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:25.251666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 775/1505] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:45:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:45:25.299443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f304b-e79d-4aaa-9083-db5fb363f5c7 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:25.299975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f304b-e79d-4aaa-9083-db5fb363f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:25.300083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f304b-e79d-4aaa-9083-db5fb363f5c7 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:25.301306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 731/1506] 10.222.0.30 () {52 vars in 830 bytes} [Tue Oct 4 12:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:45:25.305191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:25.306450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:25.414525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94890-9d54-464c-8cd6-c665ea553bcc service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:25.511668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:25.512382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:25.512565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:25.512836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] PATH_INFO: `/v3/users/254b2f1547d24325a9cfb61a7c2d4e19` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:25.527476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=254b2f1547d24325a9cfb61a7c2d4e19)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:25.528533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:45:25.528533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: warnings.warn(msg) Oct 04 12:45:25.528533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: Oct 04 12:45:25.529795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:25.539441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:25.596546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254b2f1547d24325a9cfb61a7c2d4e19'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:25.597088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254b2f1547d24325a9cfb61a7c2d4e19'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:25.610811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254b2f1547d24325a9cfb61a7c2d4e19'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:25.611296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254b2f1547d24325a9cfb61a7c2d4e19'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:25.635432 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254b2f1547d24325a9cfb61a7c2d4e19'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:25.651004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 776/1507] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:45:25 2022] DELETE /identity/v3/users/254b2f1547d24325a9cfb61a7c2d4e19 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:45:25.661634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e450f-118e-4e5d-9d6f-4f2966465ae9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:25.661923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e450f-118e-4e5d-9d6f-4f2966465ae9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:25.662204 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e450f-118e-4e5d-9d6f-4f2966465ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:25.725483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b26e450f-118e-4e5d-9d6f-4f2966465ae9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:45:25.726657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b26e450f-118e-4e5d-9d6f-4f2966465ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:25.801938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:25.814486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 732/1508] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:45:25.825324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:25.826598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:25.925093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ecded-fbe9-4df3-ba48-0a1c8046bbca admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:25.983063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:26.005894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453865d-0bc1-4357-a8c0-c6e50e5e30d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:26.006512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453865d-0bc1-4357-a8c0-c6e50e5e30d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:26.006790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453865d-0bc1-4357-a8c0-c6e50e5e30d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:26.007057 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453865d-0bc1-4357-a8c0-c6e50e5e30d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:26.008646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0453865d-0bc1-4357-a8c0-c6e50e5e30d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:26.119514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453865d-0bc1-4357-a8c0-c6e50e5e30d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:26.121007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453865d-0bc1-4357-a8c0-c6e50e5e30d9 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:26.142236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 777/1509] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:45:26.524607 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e450f-118e-4e5d-9d6f-4f2966465ae9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:45:26.526038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b26e450f-118e-4e5d-9d6f-4f2966465ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:45:26.538015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e450f-118e-4e5d-9d6f-4f2966465ae9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:45:26.642426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:45:26.643063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:45:26.643336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:45:26.643607 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] PATH_INFO: `/v3/projects/bccbfd5e5fbb41deb775b202ea3ab986` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:45:26.654669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bccbfd5e5fbb41deb775b202ea3ab986)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:45:26.655711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:45:26.655711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: warnings.warn(msg) Oct 04 12:45:26.655711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: Oct 04 12:45:26.656906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:45:26.716713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bccbfd5e5fbb41deb775b202ea3ab986', 'request_id': 'req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:26.723645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bccbfd5e5fbb41deb775b202ea3ab986', 'request_id': 'req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:26.733680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bccbfd5e5fbb41deb775b202ea3ab986', 'request_id': 'req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:26.762878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] The token cache is being invalidate because project bccbfd5e5fbb41deb775b202ea3ab986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:45:26.763175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:26.763710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e34dbf8c-2688-466f-a6ea-3fc2dab5fa64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:45:26.765026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 733/1510] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:45:26 2022] DELETE /identity/v3/projects/bccbfd5e5fbb41deb775b202ea3ab986 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:45:36.139696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=62 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:45:36.760849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:47:01.460497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56a56-4e0d-4568-80bb-d585b6fa74f4 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:01.461064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56a56-4e0d-4568-80bb-d585b6fa74f4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:01.461064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e56a56-4e0d-4568-80bb-d585b6fa74f4 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:01.462431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 778/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:01.467316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f04a-469a-4d81-8cba-619b31987723 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:01.467744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f04a-469a-4d81-8cba-619b31987723 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:01.467868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f04a-469a-4d81-8cba-619b31987723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:01.547086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d952f04a-469a-4d81-8cba-619b31987723 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:01.548301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d952f04a-469a-4d81-8cba-619b31987723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:01.650056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 734/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:01.806466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e56a56-4e0d-4568-80bb-d585b6fa74f4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:01.808642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-77e56a56-4e0d-4568-80bb-d585b6fa74f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:01.925217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e56a56-4e0d-4568-80bb-d585b6fa74f4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:01.931260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b0429-85e9-48e3-90d7-7e94809239b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:01.931867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b0429-85e9-48e3-90d7-7e94809239b8 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:01.932150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b0429-85e9-48e3-90d7-7e94809239b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:01.932427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b0429-85e9-48e3-90d7-7e94809239b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:01.940438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b0429-85e9-48e3-90d7-7e94809239b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:01.942055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b0429-85e9-48e3-90d7-7e94809239b8 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:01.951793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 779/1513] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:03.036970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eadc90-418a-4e0e-889f-2883d45ed7f0 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:03.038027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eadc90-418a-4e0e-889f-2883d45ed7f0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:03.038027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eadc90-418a-4e0e-889f-2883d45ed7f0 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:03.039281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 735/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:03.045795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce711-727c-4897-9ca4-9f17b7fcef72 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:03.046346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce711-727c-4897-9ca4-9f17b7fcef72 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:03.046447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ce711-727c-4897-9ca4-9f17b7fcef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:03.066700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-710ce711-727c-4897-9ca4-9f17b7fcef72 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:03.067938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-710ce711-727c-4897-9ca4-9f17b7fcef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:03.075910 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 780/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:03.228248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eadc90-418a-4e0e-889f-2883d45ed7f0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:03.242655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eadc90-418a-4e0e-889f-2883d45ed7f0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:03.248204 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca2706-f47c-4630-8c03-730b65129deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:03.248808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca2706-f47c-4630-8c03-730b65129deb service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:03.249092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca2706-f47c-4630-8c03-730b65129deb service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:03.249372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca2706-f47c-4630-8c03-730b65129deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:03.257504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca2706-f47c-4630-8c03-730b65129deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:03.259167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca2706-f47c-4630-8c03-730b65129deb service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:03.269062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 736/1516] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:03.457714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e57e-7ccb-4ca4-b5d6-07905195e564 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:03.458060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e57e-7ccb-4ca4-b5d6-07905195e564 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:03.458336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e57e-7ccb-4ca4-b5d6-07905195e564 None None] PATH_INFO: `/v3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:03.460148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 781/1517] 10.222.0.60 () {54 vars in 925 bytes} [Tue Oct 4 12:47:03 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:47:03.466367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd127d-abbf-4411-beac-71ef0e6e74db None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:03.466657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd127d-abbf-4411-beac-71ef0e6e74db None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:03.466937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd127d-abbf-4411-beac-71ef0e6e74db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:03.525787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f7dd127d-abbf-4411-beac-71ef0e6e74db None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:03.526909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f7dd127d-abbf-4411-beac-71ef0e6e74db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:03.544169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:47:03.600869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 737/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Oct 4 12:47:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:07.231965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20726e-8f0e-4c87-a3d2-e3fb6611e82c None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:07.232468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20726e-8f0e-4c87-a3d2-e3fb6611e82c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:07.232578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20726e-8f0e-4c87-a3d2-e3fb6611e82c None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:07.233934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 782/1519] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 4 12:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:07.239734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750026e3-e220-4d8a-9b61-eab035f0e2e1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:07.240218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750026e3-e220-4d8a-9b61-eab035f0e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:07.240314 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750026e3-e220-4d8a-9b61-eab035f0e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:07.260018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-750026e3-e220-4d8a-9b61-eab035f0e2e1 None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:07.261237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-750026e3-e220-4d8a-9b61-eab035f0e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:07.270332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 738/1520] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 4 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:47:07.280207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20726e-8f0e-4c87-a3d2-e3fb6611e82c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:07.294562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20726e-8f0e-4c87-a3d2-e3fb6611e82c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:07.299434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475a289-3305-42cc-bf7c-41e965223e47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:07.300029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475a289-3305-42cc-bf7c-41e965223e47 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:07.300309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475a289-3305-42cc-bf7c-41e965223e47 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:07.300585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475a289-3305-42cc-bf7c-41e965223e47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:07.309323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475a289-3305-42cc-bf7c-41e965223e47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:07.310941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475a289-3305-42cc-bf7c-41e965223e47 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:07.320985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 783/1521] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:14.756456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505906e4-ffd4-4854-86ea-80584fcf4844 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:14.757694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505906e4-ffd4-4854-86ea-80584fcf4844 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:14.757694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505906e4-ffd4-4854-86ea-80584fcf4844 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:14.758871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 739/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:14.765054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d72189-1dad-45b5-8054-cc0d74285b2f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:14.765526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d72189-1dad-45b5-8054-cc0d74285b2f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:14.765670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d72189-1dad-45b5-8054-cc0d74285b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:14.784886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d6d72189-1dad-45b5-8054-cc0d74285b2f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:14.786121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d6d72189-1dad-45b5-8054-cc0d74285b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:14.794387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 784/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:14.946407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505906e4-ffd4-4854-86ea-80584fcf4844 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:14.960748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505906e4-ffd4-4854-86ea-80584fcf4844 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:14.966065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00ab43-e4dd-4071-91bb-11cf776f3d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:14.966659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00ab43-e4dd-4071-91bb-11cf776f3d8a service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:14.966937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00ab43-e4dd-4071-91bb-11cf776f3d8a service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:14.967212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00ab43-e4dd-4071-91bb-11cf776f3d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:14.975063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00ab43-e4dd-4071-91bb-11cf776f3d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:14.977159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00ab43-e4dd-4071-91bb-11cf776f3d8a service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:14.986378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 740/1524] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:16.049281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77218615-bb5d-429a-85ae-7c7e9bb6464e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:16.049748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77218615-bb5d-429a-85ae-7c7e9bb6464e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:16.049850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77218615-bb5d-429a-85ae-7c7e9bb6464e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:16.051243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 785/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 12:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:16.057850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2a3de-588a-4c05-b93e-e41b010a71c9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:16.058304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2a3de-588a-4c05-b93e-e41b010a71c9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:16.058409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2a3de-588a-4c05-b93e-e41b010a71c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:16.078474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f9d2a3de-588a-4c05-b93e-e41b010a71c9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:16.079670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f9d2a3de-588a-4c05-b93e-e41b010a71c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:16.087469 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 741/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:16.239361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77218615-bb5d-429a-85ae-7c7e9bb6464e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:16.254839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77218615-bb5d-429a-85ae-7c7e9bb6464e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:16.260952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaed8c-c059-428e-9bee-c120c3194b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:16.261546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaed8c-c059-428e-9bee-c120c3194b62 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:16.261856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaed8c-c059-428e-9bee-c120c3194b62 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:16.262128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaed8c-c059-428e-9bee-c120c3194b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:16.274330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaed8c-c059-428e-9bee-c120c3194b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:16.275930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaed8c-c059-428e-9bee-c120c3194b62 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:16.285555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 786/1527] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:20.369198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb449414-a117-4a91-899b-490ef51fa331 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:20.369774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb449414-a117-4a91-899b-490ef51fa331 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:20.369774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb449414-a117-4a91-899b-490ef51fa331 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:20.371157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 742/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:20.376291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed82c5f-e8c1-4df5-96dd-af192de542b1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:20.376721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed82c5f-e8c1-4df5-96dd-af192de542b1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:20.376843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed82c5f-e8c1-4df5-96dd-af192de542b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:20.396786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6ed82c5f-e8c1-4df5-96dd-af192de542b1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:20.398556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6ed82c5f-e8c1-4df5-96dd-af192de542b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:20.406364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 787/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:20.691615 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb449414-a117-4a91-899b-490ef51fa331 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:20.693448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fb449414-a117-4a91-899b-490ef51fa331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:20.771051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb449414-a117-4a91-899b-490ef51fa331 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:20.774902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5193777-e5af-4069-a574-cf21e7366338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:20.775509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193777-e5af-4069-a574-cf21e7366338 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:20.775792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193777-e5af-4069-a574-cf21e7366338 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:20.776098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193777-e5af-4069-a574-cf21e7366338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:20.785195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5193777-e5af-4069-a574-cf21e7366338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:20.786663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5193777-e5af-4069-a574-cf21e7366338 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:20.796428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 743/1530] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:22.957014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ff53-1417-4d53-841b-f16b998119e1 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:22.957623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ff53-1417-4d53-841b-f16b998119e1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:22.957623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ff53-1417-4d53-841b-f16b998119e1 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:22.958941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 788/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:22.964511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956b66b-3c05-4f4e-8735-eea304de76d6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:22.964990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956b66b-3c05-4f4e-8735-eea304de76d6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:22.965094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956b66b-3c05-4f4e-8735-eea304de76d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:22.984451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3956b66b-3c05-4f4e-8735-eea304de76d6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:22.986222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3956b66b-3c05-4f4e-8735-eea304de76d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:22.994745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 744/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:23.286667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399ff53-1417-4d53-841b-f16b998119e1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:23.297303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399ff53-1417-4d53-841b-f16b998119e1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:23.300864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288409da-fbf5-4a0d-bf84-65158836e243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:23.301464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288409da-fbf5-4a0d-bf84-65158836e243 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:23.301785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288409da-fbf5-4a0d-bf84-65158836e243 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:23.302065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288409da-fbf5-4a0d-bf84-65158836e243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:23.311855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288409da-fbf5-4a0d-bf84-65158836e243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:23.313299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288409da-fbf5-4a0d-bf84-65158836e243 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:23.323459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 789/1533] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:26.962082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1648b-b876-4149-8a12-0c281a2b384d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:26.962627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1648b-b876-4149-8a12-0c281a2b384d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:26.962627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1648b-b876-4149-8a12-0c281a2b384d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:26.963999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 745/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:26.969235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34a6c2-bc6b-452c-bad8-949a1ddd5aaf None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:26.969714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34a6c2-bc6b-452c-bad8-949a1ddd5aaf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:26.969830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34a6c2-bc6b-452c-bad8-949a1ddd5aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:26.978048 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=81 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:47:26.991540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9e34a6c2-bc6b-452c-bad8-949a1ddd5aaf None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:26.992732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9e34a6c2-bc6b-452c-bad8-949a1ddd5aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:27.000522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 790/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:27.307440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1648b-b876-4149-8a12-0c281a2b384d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:27.309104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-40b1648b-b876-4149-8a12-0c281a2b384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:27.373365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:47:27.386553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1648b-b876-4149-8a12-0c281a2b384d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:27.390088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13eaac4-4198-4327-91be-3b29509c0651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:27.390687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eaac4-4198-4327-91be-3b29509c0651 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:27.390965 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eaac4-4198-4327-91be-3b29509c0651 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:27.391235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13eaac4-4198-4327-91be-3b29509c0651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:27.400796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13eaac4-4198-4327-91be-3b29509c0651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:27.402259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13eaac4-4198-4327-91be-3b29509c0651 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:27.411367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 746/1536] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:29.562978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdad3f-42be-4617-9f9a-54a97e6ea0cb None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:29.563510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdad3f-42be-4617-9f9a-54a97e6ea0cb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:29.563510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdad3f-42be-4617-9f9a-54a97e6ea0cb None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:29.564878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 791/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 12:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:47:29.570083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a78032-b3e9-495a-aa4f-d55309f92b31 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:29.570542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a78032-b3e9-495a-aa4f-d55309f92b31 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:29.570639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a78032-b3e9-495a-aa4f-d55309f92b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:29.590277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e7a78032-b3e9-495a-aa4f-d55309f92b31 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:47:29.591471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e7a78032-b3e9-495a-aa4f-d55309f92b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:29.599497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 747/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 12:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:47:29.902926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdad3f-42be-4617-9f9a-54a97e6ea0cb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:47:29.904610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4bcdad3f-42be-4617-9f9a-54a97e6ea0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:47:29.917744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdad3f-42be-4617-9f9a-54a97e6ea0cb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:47:29.921241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0432ac0-02ba-4036-9a52-82279d46139c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:47:29.921934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0432ac0-02ba-4036-9a52-82279d46139c service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:47:29.922211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0432ac0-02ba-4036-9a52-82279d46139c service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:47:29.922481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0432ac0-02ba-4036-9a52-82279d46139c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:47:29.931686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0432ac0-02ba-4036-9a52-82279d46139c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:47:29.933086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0432ac0-02ba-4036-9a52-82279d46139c service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:47:29.942229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 792/1539] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:47:39.585512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=11 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:47:39.938124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=8 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:57.273362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447031-3037-4c3f-b489-373efdb27a81 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.274508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447031-3037-4c3f-b489-373efdb27a81 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.275059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7447031-3037-4c3f-b489-373efdb27a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.306865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d7447031-3037-4c3f-b489-373efdb27a81 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.308289 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d7447031-3037-4c3f-b489-373efdb27a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.319258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 748/1540] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.328568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995dec3-1e39-4778-beba-8ec431ed0bcc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.329175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995dec3-1e39-4778-beba-8ec431ed0bcc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.329175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995dec3-1e39-4778-beba-8ec431ed0bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.366185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3995dec3-1e39-4778-beba-8ec431ed0bcc None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.367570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3995dec3-1e39-4778-beba-8ec431ed0bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.382259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 793/1541] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.386726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447031-3037-4c3f-b489-373efdb27a81 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:57.403408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7447031-3037-4c3f-b489-373efdb27a81 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:57.414130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ab170-2444-40b3-8e8f-7cf7c91c2cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:57.415065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab170-2444-40b3-8e8f-7cf7c91c2cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.415511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab170-2444-40b3-8e8f-7cf7c91c2cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.415942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab170-2444-40b3-8e8f-7cf7c91c2cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.416770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ab170-2444-40b3-8e8f-7cf7c91c2cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:48:57.417244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ab170-2444-40b3-8e8f-7cf7c91c2cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:57.420471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ab170-2444-40b3-8e8f-7cf7c91c2cd6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:57.439798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 749/1542] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:48:57.451369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995dec3-1e39-4778-beba-8ec431ed0bcc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:57.467502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995dec3-1e39-4778-beba-8ec431ed0bcc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:57.477512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2ab2-3ad0-4a8d-b9e7-67af28acedc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:57.478174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2ab2-3ad0-4a8d-b9e7-67af28acedc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.478455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2ab2-3ad0-4a8d-b9e7-67af28acedc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.478728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2ab2-3ad0-4a8d-b9e7-67af28acedc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.479371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2ab2-3ad0-4a8d-b9e7-67af28acedc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:57.481300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2ab2-3ad0-4a8d-b9e7-67af28acedc1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:57.500529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be502-dc7f-4779-ae20-b907505fb746 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.501303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be502-dc7f-4779-ae20-b907505fb746 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.501587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be502-dc7f-4779-ae20-b907505fb746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.553944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-bc8be502-dc7f-4779-ae20-b907505fb746 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.555079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bc8be502-dc7f-4779-ae20-b907505fb746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.565710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 794/1543] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:57.571239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2ab2-3ad0-4a8d-b9e7-67af28acedc1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:57.689993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 750/1544] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.692010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d28cc2-2700-4c13-a09a-1af6f41c954b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.692514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d28cc2-2700-4c13-a09a-1af6f41c954b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.692986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d28cc2-2700-4c13-a09a-1af6f41c954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.701217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2ab2-3ad0-4a8d-b9e7-67af28acedc1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:57.722380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe05447-2e4a-49b7-8ec7-ced4df236780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:57.723011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe05447-2e4a-49b7-8ec7-ced4df236780 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.723294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe05447-2e4a-49b7-8ec7-ced4df236780 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.723573 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe05447-2e4a-49b7-8ec7-ced4df236780 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.724210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe05447-2e4a-49b7-8ec7-ced4df236780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:57.725278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-6fe05447-2e4a-49b7-8ec7-ced4df236780 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:48:57.725278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: warnings.warn(msg) Oct 04 12:48:57.725278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: Oct 04 12:48:57.726820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d5d28cc2-2700-4c13-a09a-1af6f41c954b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.728047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d5d28cc2-2700-4c13-a09a-1af6f41c954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.729952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe05447-2e4a-49b7-8ec7-ced4df236780 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:57.744461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 751/1545] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.746020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e82729-d406-48db-808c-41875c8a284e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.746176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e82729-d406-48db-808c-41875c8a284e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.746437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e82729-d406-48db-808c-41875c8a284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.763138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 795/1546] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:57.765056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f41df9-50e2-4f54-930c-13fd64136a99 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.765344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f41df9-50e2-4f54-930c-13fd64136a99 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.765630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f41df9-50e2-4f54-930c-13fd64136a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.770902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-85e82729-d406-48db-808c-41875c8a284e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.773018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-85e82729-d406-48db-808c-41875c8a284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.784331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 752/1547] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.786069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d8213-371f-4a5c-8855-4991da0cf380 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.786463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d8213-371f-4a5c-8855-4991da0cf380 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.786842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d8213-371f-4a5c-8855-4991da0cf380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.787547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-12f41df9-50e2-4f54-930c-13fd64136a99 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.788940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-12f41df9-50e2-4f54-930c-13fd64136a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.799369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 796/1548] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.800972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf94c-8c65-44b8-a8ca-1d11a2ea042c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.801423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf94c-8c65-44b8-a8ca-1d11a2ea042c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.801997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf94c-8c65-44b8-a8ca-1d11a2ea042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.812298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-617d8213-371f-4a5c-8855-4991da0cf380 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.813446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-617d8213-371f-4a5c-8855-4991da0cf380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.822230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 753/1549] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.823075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-76bcf94c-8c65-44b8-a8ca-1d11a2ea042c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.824263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-76bcf94c-8c65-44b8-a8ca-1d11a2ea042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.825825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd508-e4cf-4584-bd5f-bd0a9d008eb4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.826134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd508-e4cf-4584-bd5f-bd0a9d008eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.826477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6dd508-e4cf-4584-bd5f-bd0a9d008eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.832432 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 797/1550] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.833663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c239-f7c0-4457-960b-b29e33c161d5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.833953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c239-f7c0-4457-960b-b29e33c161d5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.834830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7c239-f7c0-4457-960b-b29e33c161d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.851302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7e6dd508-e4cf-4584-bd5f-bd0a9d008eb4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.852512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7e6dd508-e4cf-4584-bd5f-bd0a9d008eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.854078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a8d7c239-f7c0-4457-960b-b29e33c161d5 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.855241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a8d7c239-f7c0-4457-960b-b29e33c161d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.860389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 754/1551] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.861223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd508-e4cf-4584-bd5f-bd0a9d008eb4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:57.867724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 798/1552] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.869033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a05c-d014-479e-8fe8-acb9ea1c36c3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.869323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a05c-d014-479e-8fe8-acb9ea1c36c3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.869632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a05c-d014-479e-8fe8-acb9ea1c36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.872115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6dd508-e4cf-4584-bd5f-bd0a9d008eb4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:57.876619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87b54c-18a7-4c92-839b-6714b32bc271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:57.877215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87b54c-18a7-4c92-839b-6714b32bc271 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.877493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87b54c-18a7-4c92-839b-6714b32bc271 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.877799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87b54c-18a7-4c92-839b-6714b32bc271 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.878800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87b54c-18a7-4c92-839b-6714b32bc271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:57.880045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87b54c-18a7-4c92-839b-6714b32bc271 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:57.889756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3224a05c-d014-479e-8fe8-acb9ea1c36c3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.890968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3224a05c-d014-479e-8fe8-acb9ea1c36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.891656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 755/1553] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:57.892533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87b54c-18a7-4c92-839b-6714b32bc271 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:57.899441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 799/1554] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.900654 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a15ed-bddb-4b21-b5fd-dcb3204082c1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.900942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a15ed-bddb-4b21-b5fd-dcb3204082c1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.901213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a15ed-bddb-4b21-b5fd-dcb3204082c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.904743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87b54c-18a7-4c92-839b-6714b32bc271 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:57.909263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ea60d-814a-4832-b072-4d6b03337273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:57.909893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea60d-814a-4832-b072-4d6b03337273 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.910173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea60d-814a-4832-b072-4d6b03337273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.910450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ea60d-814a-4832-b072-4d6b03337273 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.911086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ea60d-814a-4832-b072-4d6b03337273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:48:57.911389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ea60d-814a-4832-b072-4d6b03337273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:57.913057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ea60d-814a-4832-b072-4d6b03337273 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:57.920683 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4b8a15ed-bddb-4b21-b5fd-dcb3204082c1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.921917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4b8a15ed-bddb-4b21-b5fd-dcb3204082c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.924946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 756/1555] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:48:57.926238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba18c-880a-4df3-93d5-226ef51ee913 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.926523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba18c-880a-4df3-93d5-226ef51ee913 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.926794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba18c-880a-4df3-93d5-226ef51ee913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.937102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 800/1556] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.938536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1741ab-1cd4-4664-a24e-d3e11ddd495f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.938913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1741ab-1cd4-4664-a24e-d3e11ddd495f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.939195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1741ab-1cd4-4664-a24e-d3e11ddd495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.953893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-60eba18c-880a-4df3-93d5-226ef51ee913 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.955124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-60eba18c-880a-4df3-93d5-226ef51ee913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.960212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ec1741ab-1cd4-4664-a24e-d3e11ddd495f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.961381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ec1741ab-1cd4-4664-a24e-d3e11ddd495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:57.963767 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 757/1557] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.964564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba18c-880a-4df3-93d5-226ef51ee913 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:57.969803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 801/1558] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:57.974439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba18c-880a-4df3-93d5-226ef51ee913 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:57.974575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9af8c-53d5-4044-833d-1003a80e3a37 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.974890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9af8c-53d5-4044-833d-1003a80e3a37 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.975166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9af8c-53d5-4044-833d-1003a80e3a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.979035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:57.979631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:57.979914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:57.980185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:57.980828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:48:57.981133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:57.982965 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:57.996410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bfd9af8c-53d5-4044-833d-1003a80e3a37 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:57.996606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 758/1559] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:48:57.997367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:57.997770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bfd9af8c-53d5-4044-833d-1003a80e3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:58.005815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 802/1560] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:58.007310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9af8c-53d5-4044-833d-1003a80e3a37 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.009366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb00c-5908-434e-947b-512e15bd986f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.014404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e67143-a452-4f72-9bce-c2f1181bc63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.015001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67143-a452-4f72-9bce-c2f1181bc63d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.015282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67143-a452-4f72-9bce-c2f1181bc63d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.015557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67143-a452-4f72-9bce-c2f1181bc63d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.016190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e67143-a452-4f72-9bce-c2f1181bc63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.016589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9af8c-53d5-4044-833d-1003a80e3a37 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.017858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e67143-a452-4f72-9bce-c2f1181bc63d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.021435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06779e-8dd7-4644-8d95-6caafb4739da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.022149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06779e-8dd7-4644-8d95-6caafb4739da admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.022429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06779e-8dd7-4644-8d95-6caafb4739da admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.022701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06779e-8dd7-4644-8d95-6caafb4739da admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.023733 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06779e-8dd7-4644-8d95-6caafb4739da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:48:58.023733 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06779e-8dd7-4644-8d95-6caafb4739da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.024627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-cb06779e-8dd7-4644-8d95-6caafb4739da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:48:58.024627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: warnings.warn(msg) Oct 04 12:48:58.024627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: Oct 04 12:48:58.025506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06779e-8dd7-4644-8d95-6caafb4739da admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.028967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 759/1561] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:58.029787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e67143-a452-4f72-9bce-c2f1181bc63d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.038699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 803/1562] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:48:58.040119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61479c48-4010-4261-8b5a-a64306efe37a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.040486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61479c48-4010-4261-8b5a-a64306efe37a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.040811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61479c48-4010-4261-8b5a-a64306efe37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.048772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e67143-a452-4f72-9bce-c2f1181bc63d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.054703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.055335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.055618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.056227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.056757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.057810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:48:58.057810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: warnings.warn(msg) Oct 04 12:48:58.057810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: Oct 04 12:48:58.059003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.062794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-61479c48-4010-4261-8b5a-a64306efe37a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:58.063938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-61479c48-4010-4261-8b5a-a64306efe37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:58.072451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 804/1563] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:58.073385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61479c48-4010-4261-8b5a-a64306efe37a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.083480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61479c48-4010-4261-8b5a-a64306efe37a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.090580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 760/1564] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.090580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.094329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.094947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.095549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.095670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.096290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:48:58.097034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.098225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.110588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 805/1565] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:48:58.111303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.122706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0a83d-e38a-4374-8ea6-b489188d2936 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.140639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:58.153991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:58.163211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0255c-fb52-4842-a8b9-27158a9104bd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.167942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.168556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.168838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.169111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.169786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:48:58.170095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.171709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.183120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b072f-266c-4b34-8aaf-a46216ec12aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.183816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b072f-266c-4b34-8aaf-a46216ec12aa admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.184172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b072f-266c-4b34-8aaf-a46216ec12aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.184508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b072f-266c-4b34-8aaf-a46216ec12aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.185165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b072f-266c-4b34-8aaf-a46216ec12aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.185625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 761/1566] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:48:58.186370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.187112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b072f-266c-4b34-8aaf-a46216ec12aa admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.202025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79a33b-838a-4881-8e88-617f33c3ce03 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.206704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.207299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.207591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.207897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.208590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:48:58.208940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.210627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.218560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 806/1567] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.218560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b072f-266c-4b34-8aaf-a46216ec12aa admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.230875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 762/1568] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:48:58.230875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.241482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69153ba-7732-42c4-8384-fcdd84ce2bf1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.279204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b072f-266c-4b34-8aaf-a46216ec12aa admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.284051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba32c33-49fa-4a24-9e23-c319b6225eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.284747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba32c33-49fa-4a24-9e23-c319b6225eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.285031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba32c33-49fa-4a24-9e23-c319b6225eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.285299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba32c33-49fa-4a24-9e23-c319b6225eeb admin admin] PATH_INFO: `/v3/projects/24a6736725664e70949e70f7f61843cb/users/9189ff7b40604c5ba6848678cc356e41/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.300663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb7555-88f7-4d11-89f0-6ccc418e1043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.301311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7555-88f7-4d11-89f0-6ccc418e1043 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.301606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7555-88f7-4d11-89f0-6ccc418e1043 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.301898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb7555-88f7-4d11-89f0-6ccc418e1043 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.302141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba32c33-49fa-4a24-9e23-c319b6225eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a6736725664e70949e70f7f61843cb, user_id=9189ff7b40604c5ba6848678cc356e41, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.302587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb7555-88f7-4d11-89f0-6ccc418e1043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.305181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb7555-88f7-4d11-89f0-6ccc418e1043 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.305387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba32c33-49fa-4a24-9e23-c319b6225eeb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.318653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 807/1569] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:48:58 2022] PUT /identity/v3/projects/24a6736725664e70949e70f7f61843cb/users/9189ff7b40604c5ba6848678cc356e41/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:48:58.319343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba32c33-49fa-4a24-9e23-c319b6225eeb admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.339029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 763/1570] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.339029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb7555-88f7-4d11-89f0-6ccc418e1043 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.389857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba32c33-49fa-4a24-9e23-c319b6225eeb admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.407339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb7555-88f7-4d11-89f0-6ccc418e1043 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.413230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262268e-002c-4ffd-84ba-dd51d08621bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.413898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262268e-002c-4ffd-84ba-dd51d08621bf admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.414239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262268e-002c-4ffd-84ba-dd51d08621bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.414531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262268e-002c-4ffd-84ba-dd51d08621bf admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.415154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262268e-002c-4ffd-84ba-dd51d08621bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.417176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262268e-002c-4ffd-84ba-dd51d08621bf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.438845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:58.442151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 764/1571] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.442965 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262268e-002c-4ffd-84ba-dd51d08621bf admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.452815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262268e-002c-4ffd-84ba-dd51d08621bf admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.454249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.454867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.455179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.455452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.456115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:48:58.456408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.457622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def3e2-b66b-4285-ad6e-df01ceeecb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.458052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.458266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def3e2-b66b-4285-ad6e-df01ceeecb5a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.458526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def3e2-b66b-4285-ad6e-df01ceeecb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.458800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def3e2-b66b-4285-ad6e-df01ceeecb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.459614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30def3e2-b66b-4285-ad6e-df01ceeecb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.461441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30def3e2-b66b-4285-ad6e-df01ceeecb5a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.472664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 808/1572] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:48:58.481656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.493133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 765/1573] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.493133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def3e2-b66b-4285-ad6e-df01ceeecb5a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.493435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f89019-3bb6-4af5-a2be-329bcd01f8fa admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.504326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:58.552562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d1e64-fc79-4c12-a8da-ab1459255ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.553764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d1e64-fc79-4c12-a8da-ab1459255ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.554050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d1e64-fc79-4c12-a8da-ab1459255ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.554331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d1e64-fc79-4c12-a8da-ab1459255ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.554956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d1e64-fc79-4c12-a8da-ab1459255ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.555073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def3e2-b66b-4285-ad6e-df01ceeecb5a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.556879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d1e64-fc79-4c12-a8da-ab1459255ac8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.559646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ea76-8549-4660-a14d-5f26a73aa6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.560252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ea76-8549-4660-a14d-5f26a73aa6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.560535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ea76-8549-4660-a14d-5f26a73aa6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.560807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ea76-8549-4660-a14d-5f26a73aa6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.561429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ea76-8549-4660-a14d-5f26a73aa6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.563384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ea76-8549-4660-a14d-5f26a73aa6c6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.586231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 809/1574] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.586968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d1e64-fc79-4c12-a8da-ab1459255ac8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.588404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 766/1575] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.589864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304e09-0cfe-446c-8dcb-f6cc96722887 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.590160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304e09-0cfe-446c-8dcb-f6cc96722887 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.590433 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c304e09-0cfe-446c-8dcb-f6cc96722887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.619684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3c304e09-0cfe-446c-8dcb-f6cc96722887 None None] MFA Rules not processed for user `9189ff7b40604c5ba6848678cc356e41`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:58.621014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3c304e09-0cfe-446c-8dcb-f6cc96722887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:58.654417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d1e64-fc79-4c12-a8da-ab1459255ac8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.659071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f59da9-ed76-4fc1-baeb-91bc5a4400ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.659686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59da9-ed76-4fc1-baeb-91bc5a4400ae admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.659968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59da9-ed76-4fc1-baeb-91bc5a4400ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.660241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f59da9-ed76-4fc1-baeb-91bc5a4400ae admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.660870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f59da9-ed76-4fc1-baeb-91bc5a4400ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.663374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f59da9-ed76-4fc1-baeb-91bc5a4400ae admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.687096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 767/1576] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:58.688253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c304e09-0cfe-446c-8dcb-f6cc96722887 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.693847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 810/1577] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.693847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f59da9-ed76-4fc1-baeb-91bc5a4400ae admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.700448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c304e09-0cfe-446c-8dcb-f6cc96722887 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.750523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:58.761972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f59da9-ed76-4fc1-baeb-91bc5a4400ae admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.766234 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44f3dd-21ab-4922-b787-b5532e3d1bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.766502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf872157-ea07-4063-a08e-f4369a1a4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.766850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f3dd-21ab-4922-b787-b5532e3d1bac admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.767116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872157-ea07-4063-a08e-f4369a1a4dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.767227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f3dd-21ab-4922-b787-b5532e3d1bac admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.767383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872157-ea07-4063-a08e-f4369a1a4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.767493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f3dd-21ab-4922-b787-b5532e3d1bac admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.767653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872157-ea07-4063-a08e-f4369a1a4dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.768139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44f3dd-21ab-4922-b787-b5532e3d1bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.768291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf872157-ea07-4063-a08e-f4369a1a4dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.769955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf872157-ea07-4063-a08e-f4369a1a4dd0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.770155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44f3dd-21ab-4922-b787-b5532e3d1bac admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.780582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 811/1578] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:58.782118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf872157-ea07-4063-a08e-f4369a1a4dd0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.792818 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf872157-ea07-4063-a08e-f4369a1a4dd0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.793616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 768/1579] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.794490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44f3dd-21ab-4922-b787-b5532e3d1bac admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.800430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2f6ad-53f5-42dc-894b-02baee641cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.801042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2f6ad-53f5-42dc-894b-02baee641cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.801324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2f6ad-53f5-42dc-894b-02baee641cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.801641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2f6ad-53f5-42dc-894b-02baee641cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.802298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2f6ad-53f5-42dc-894b-02baee641cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.804078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44f3dd-21ab-4922-b787-b5532e3d1bac admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.804392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2f6ad-53f5-42dc-894b-02baee641cc6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.808970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8b610-7f26-4ddd-8325-5a183185dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.809569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b610-7f26-4ddd-8325-5a183185dae8 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.809880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b610-7f26-4ddd-8325-5a183185dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.810157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8b610-7f26-4ddd-8325-5a183185dae8 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.810773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8b610-7f26-4ddd-8325-5a183185dae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.812741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8b610-7f26-4ddd-8325-5a183185dae8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.833544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 812/1580] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.833787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 769/1581] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/users => generated 288 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.835033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8b610-7f26-4ddd-8325-5a183185dae8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.835465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2f6ad-53f5-42dc-894b-02baee641cc6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.842088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:58.848760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8b610-7f26-4ddd-8325-5a183185dae8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.899988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2f6ad-53f5-42dc-894b-02baee641cc6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.904818 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953d52-3331-48fd-bb35-35bb9b720afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.905433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953d52-3331-48fd-bb35-35bb9b720afe admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.905744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953d52-3331-48fd-bb35-35bb9b720afe admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.906162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953d52-3331-48fd-bb35-35bb9b720afe admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.906696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953d52-3331-48fd-bb35-35bb9b720afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.908269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953d52-3331-48fd-bb35-35bb9b720afe admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.908394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868453dc-91c9-4d6a-b84a-c9fb16263f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.908941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868453dc-91c9-4d6a-b84a-c9fb16263f13 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.909209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868453dc-91c9-4d6a-b84a-c9fb16263f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.909482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868453dc-91c9-4d6a-b84a-c9fb16263f13 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.910162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868453dc-91c9-4d6a-b84a-c9fb16263f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.912082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868453dc-91c9-4d6a-b84a-c9fb16263f13 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.921887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 813/1582] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:58.921887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953d52-3331-48fd-bb35-35bb9b720afe admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.933244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953d52-3331-48fd-bb35-35bb9b720afe admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.935271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 770/1583] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.936527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca9ab-c936-425f-b343-824e8462caaf None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.936817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca9ab-c936-425f-b343-824e8462caaf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.937093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca9ab-c936-425f-b343-824e8462caaf None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.938731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 771/1584] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 4 12:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:48:58.939267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca9ab-c936-425f-b343-824e8462caaf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.942236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e9213-c7b7-4955-9830-ebeba56049c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.943096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e9213-c7b7-4955-9830-ebeba56049c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.943621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e9213-c7b7-4955-9830-ebeba56049c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.943893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e9213-c7b7-4955-9830-ebeba56049c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.944548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e9213-c7b7-4955-9830-ebeba56049c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.946502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e9213-c7b7-4955-9830-ebeba56049c8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.952229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca9ab-c936-425f-b343-824e8462caaf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.956895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665af68-b598-43e3-9fb3-9e4f0e8dd636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.957484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665af68-b598-43e3-9fb3-9e4f0e8dd636 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.957790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665af68-b598-43e3-9fb3-9e4f0e8dd636 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.958065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665af68-b598-43e3-9fb3-9e4f0e8dd636 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.958697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665af68-b598-43e3-9fb3-9e4f0e8dd636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.961045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665af68-b598-43e3-9fb3-9e4f0e8dd636 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.972080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 814/1585] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/users => generated 278 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:58.972080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e9213-c7b7-4955-9830-ebeba56049c8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.976365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 772/1586] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:58.978499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665af68-b598-43e3-9fb3-9e4f0e8dd636 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:58.980051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e9213-c7b7-4955-9830-ebeba56049c8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.984813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4cbc8-75e7-4d7f-b692-948fc7178b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.985420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4cbc8-75e7-4d7f-b692-948fc7178b59 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.985752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4cbc8-75e7-4d7f-b692-948fc7178b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.986029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4cbc8-75e7-4d7f-b692-948fc7178b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.986667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4cbc8-75e7-4d7f-b692-948fc7178b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.988275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4cbc8-75e7-4d7f-b692-948fc7178b59 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.988394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665af68-b598-43e3-9fb3-9e4f0e8dd636 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:58.993372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59153a-a1c0-4503-8b34-4481fc10d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:58.994100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59153a-a1c0-4503-8b34-4481fc10d76e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:58.994381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59153a-a1c0-4503-8b34-4481fc10d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:58.994654 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59153a-a1c0-4503-8b34-4481fc10d76e admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:58.995309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59153a-a1c0-4503-8b34-4481fc10d76e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:58.997236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59153a-a1c0-4503-8b34-4481fc10d76e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:58.998953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 815/1587] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:58.999765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4cbc8-75e7-4d7f-b692-948fc7178b59 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.010686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4cbc8-75e7-4d7f-b692-948fc7178b59 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.015638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f38ac-ac23-4e08-9e94-9626d5e17ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.016235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f38ac-ac23-4e08-9e94-9626d5e17ddc admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.016513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f38ac-ac23-4e08-9e94-9626d5e17ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.016783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f38ac-ac23-4e08-9e94-9626d5e17ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.017409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f38ac-ac23-4e08-9e94-9626d5e17ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.022800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 773/1588] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:48:58 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:48:59.022960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f38ac-ac23-4e08-9e94-9626d5e17ddc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.023066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59153a-a1c0-4503-8b34-4481fc10d76e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.033039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 816/1589] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.033039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f38ac-ac23-4e08-9e94-9626d5e17ddc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.033305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59153a-a1c0-4503-8b34-4481fc10d76e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.039333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9abac-958c-4c89-ba6d-47b223f1acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.039910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9abac-958c-4c89-ba6d-47b223f1acbe admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.040194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9abac-958c-4c89-ba6d-47b223f1acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.040462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9abac-958c-4c89-ba6d-47b223f1acbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.041022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f38ac-ac23-4e08-9e94-9626d5e17ddc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.041125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9abac-958c-4c89-ba6d-47b223f1acbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.042797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9abac-958c-4c89-ba6d-47b223f1acbe admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.045837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df64ef9-a2a2-412d-9327-309aaa600769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.046435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64ef9-a2a2-412d-9327-309aaa600769 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.046706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64ef9-a2a2-412d-9327-309aaa600769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.046978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df64ef9-a2a2-412d-9327-309aaa600769 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.047607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df64ef9-a2a2-412d-9327-309aaa600769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.049185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df64ef9-a2a2-412d-9327-309aaa600769 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.056782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 774/1590] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.056782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0677966-4977-4285-9b50-9c373504a2c4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.056782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0677966-4977-4285-9b50-9c373504a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.056782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0677966-4977-4285-9b50-9c373504a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.062310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 817/1591] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.062310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df64ef9-a2a2-412d-9327-309aaa600769 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.070759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df64ef9-a2a2-412d-9327-309aaa600769 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.075516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da14957-66f2-4d0b-bb64-29077d48f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.076136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da14957-66f2-4d0b-bb64-29077d48f5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.076414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da14957-66f2-4d0b-bb64-29077d48f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.076685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da14957-66f2-4d0b-bb64-29077d48f5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.077312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da14957-66f2-4d0b-bb64-29077d48f5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.078937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da14957-66f2-4d0b-bb64-29077d48f5a8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.089836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 818/1592] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.090685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da14957-66f2-4d0b-bb64-29077d48f5a8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.095449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e0677966-4977-4285-9b50-9c373504a2c4 None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:59.096584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e0677966-4977-4285-9b50-9c373504a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:59.102184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da14957-66f2-4d0b-bb64-29077d48f5a8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.106735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fcd16-03fe-4a45-9f44-59fe2d0137f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.107389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fcd16-03fe-4a45-9f44-59fe2d0137f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.107702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fcd16-03fe-4a45-9f44-59fe2d0137f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.107941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fcd16-03fe-4a45-9f44-59fe2d0137f1 admin admin] PATH_INFO: `/v3/projects/a71aed1e62d84805b4a0d0418c39c354/users/fb62257f963b4287bb20852504d24975/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.122570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fcd16-03fe-4a45-9f44-59fe2d0137f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71aed1e62d84805b4a0d0418c39c354, user_id=fb62257f963b4287bb20852504d24975, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.125226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fcd16-03fe-4a45-9f44-59fe2d0137f1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.139648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 819/1593] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:48:59 2022] PUT /identity/v3/projects/a71aed1e62d84805b4a0d0418c39c354/users/fb62257f963b4287bb20852504d24975/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:48:59.140956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fcd16-03fe-4a45-9f44-59fe2d0137f1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.165777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 775/1594] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 4 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:59.166629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0677966-4977-4285-9b50-9c373504a2c4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.177484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0677966-4977-4285-9b50-9c373504a2c4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.187301 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:59.207273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:59.208878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fcd16-03fe-4a45-9f44-59fe2d0137f1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.214315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69548f0c-5756-448a-a4ae-2f40db89b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.214920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69548f0c-5756-448a-a4ae-2f40db89b709 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.215189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69548f0c-5756-448a-a4ae-2f40db89b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.215462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69548f0c-5756-448a-a4ae-2f40db89b709 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.216098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69548f0c-5756-448a-a4ae-2f40db89b709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.217726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69548f0c-5756-448a-a4ae-2f40db89b709 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.229326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 820/1595] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.230727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69548f0c-5756-448a-a4ae-2f40db89b709 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.238076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62502a-5482-4c78-881c-5937c814d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.238691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62502a-5482-4c78-881c-5937c814d202 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.238974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62502a-5482-4c78-881c-5937c814d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.239250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62502a-5482-4c78-881c-5937c814d202 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.239884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62502a-5482-4c78-881c-5937c814d202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.241192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69548f0c-5756-448a-a4ae-2f40db89b709 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.241519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62502a-5482-4c78-881c-5937c814d202 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.248211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3c6c-28f0-4a09-939f-ded94f437fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.248982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3c6c-28f0-4a09-939f-ded94f437fae admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.249325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3c6c-28f0-4a09-939f-ded94f437fae admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.249623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb3c6c-28f0-4a09-939f-ded94f437fae admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.250284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb3c6c-28f0-4a09-939f-ded94f437fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.251981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb3c6c-28f0-4a09-939f-ded94f437fae admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.255048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 776/1596] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.255048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62502a-5482-4c78-881c-5937c814d202 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.264627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62502a-5482-4c78-881c-5937c814d202 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.266165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 821/1597] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.267078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3c6c-28f0-4a09-939f-ded94f437fae admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.269702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdb892-5927-450a-b007-2b1386a37eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.270640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb892-5927-450a-b007-2b1386a37eff admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.270917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb892-5927-450a-b007-2b1386a37eff admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.271193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdb892-5927-450a-b007-2b1386a37eff admin admin] PATH_INFO: `/v3/projects/94a2428d1ece4a67870f17d638748bf3/users/fa4d0d66fe2944c983a735e403309d49/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.277829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb3c6c-28f0-4a09-939f-ded94f437fae admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.282698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e60a-03e1-4fde-a838-df8d5d94677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.283307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e60a-03e1-4fde-a838-df8d5d94677b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.283588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e60a-03e1-4fde-a838-df8d5d94677b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.283858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300e60a-03e1-4fde-a838-df8d5d94677b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.284501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300e60a-03e1-4fde-a838-df8d5d94677b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.286152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300e60a-03e1-4fde-a838-df8d5d94677b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.287988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdb892-5927-450a-b007-2b1386a37eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a2428d1ece4a67870f17d638748bf3, user_id=fa4d0d66fe2944c983a735e403309d49, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.289033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-b6fdb892-5927-450a-b007-2b1386a37eff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:48:59.289033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: warnings.warn(msg) Oct 04 12:48:59.289033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: Oct 04 12:48:59.291015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdb892-5927-450a-b007-2b1386a37eff admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.297129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 822/1598] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.297973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e60a-03e1-4fde-a838-df8d5d94677b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.307545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 777/1599] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:48:59 2022] PUT /identity/v3/projects/94a2428d1ece4a67870f17d638748bf3/users/fa4d0d66fe2944c983a735e403309d49/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:48:59.308791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187864f-3179-4c4d-afc6-f1a212282858 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.309079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187864f-3179-4c4d-afc6-f1a212282858 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.309352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187864f-3179-4c4d-afc6-f1a212282858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.310091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300e60a-03e1-4fde-a838-df8d5d94677b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.328490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c187864f-3179-4c4d-afc6-f1a212282858 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:59.329799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c187864f-3179-4c4d-afc6-f1a212282858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:59.369127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a83506-7f09-4809-a036-5b94792d6525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.369765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83506-7f09-4809-a036-5b94792d6525 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.370043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83506-7f09-4809-a036-5b94792d6525 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.370343 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a83506-7f09-4809-a036-5b94792d6525 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.370978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a83506-7f09-4809-a036-5b94792d6525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.372569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a83506-7f09-4809-a036-5b94792d6525 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.383042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 823/1600] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.383904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a83506-7f09-4809-a036-5b94792d6525 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.389896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 778/1601] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:59.390718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187864f-3179-4c4d-afc6-f1a212282858 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.400244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187864f-3179-4c4d-afc6-f1a212282858 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.405105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c4ba0-efc9-4e91-b57f-1b4170326c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.405796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c4ba0-efc9-4e91-b57f-1b4170326c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.406081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c4ba0-efc9-4e91-b57f-1b4170326c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.406358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c4ba0-efc9-4e91-b57f-1b4170326c30 admin admin] PATH_INFO: `/v3/projects/d3035a9299684401a9d7bfceac221704/users/063da0983af548fe90761a0ddd4f5aeb/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.421530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c4ba0-efc9-4e91-b57f-1b4170326c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3035a9299684401a9d7bfceac221704, user_id=063da0983af548fe90761a0ddd4f5aeb, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.424239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c4ba0-efc9-4e91-b57f-1b4170326c30 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.438347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 779/1602] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:48:59 2022] PUT /identity/v3/projects/d3035a9299684401a9d7bfceac221704/users/063da0983af548fe90761a0ddd4f5aeb/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:48:59.439389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c4ba0-efc9-4e91-b57f-1b4170326c30 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.465681 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a83506-7f09-4809-a036-5b94792d6525 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.501779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c4ba0-efc9-4e91-b57f-1b4170326c30 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.508158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1e4cb-1bd3-4c64-bb61-f9d288752df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.508975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1e4cb-1bd3-4c64-bb61-f9d288752df6 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.509403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1e4cb-1bd3-4c64-bb61-f9d288752df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.509781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1e4cb-1bd3-4c64-bb61-f9d288752df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.510187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:59.510423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1e4cb-1bd3-4c64-bb61-f9d288752df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.512122 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1e4cb-1bd3-4c64-bb61-f9d288752df6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.522555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 780/1603] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:48:59.523344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1e4cb-1bd3-4c64-bb61-f9d288752df6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.533209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1e4cb-1bd3-4c64-bb61-f9d288752df6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.535162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc51d04-c6d3-4412-93d9-1aeb19e7b90d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.535784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc51d04-c6d3-4412-93d9-1aeb19e7b90d service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.536060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc51d04-c6d3-4412-93d9-1aeb19e7b90d service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.536333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc51d04-c6d3-4412-93d9-1aeb19e7b90d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.538134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26ecde-d0e3-4303-8ab9-8fbfb45e29f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.538792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26ecde-d0e3-4303-8ab9-8fbfb45e29f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.539073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26ecde-d0e3-4303-8ab9-8fbfb45e29f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.539359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26ecde-d0e3-4303-8ab9-8fbfb45e29f0 admin admin] PATH_INFO: `/v3/projects/bbd4a4fc422b45ae94da28ac774906e8/users/66f98af5c7194ce58dde8258e2ecf945/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.551237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:59.555003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26ecde-d0e3-4303-8ab9-8fbfb45e29f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd4a4fc422b45ae94da28ac774906e8, user_id=66f98af5c7194ce58dde8258e2ecf945, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.559045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26ecde-d0e3-4303-8ab9-8fbfb45e29f0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.577842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 781/1604] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:48:59 2022] PUT /identity/v3/projects/bbd4a4fc422b45ae94da28ac774906e8/users/66f98af5c7194ce58dde8258e2ecf945/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:48:59.577842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26ecde-d0e3-4303-8ab9-8fbfb45e29f0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.596625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc51d04-c6d3-4412-93d9-1aeb19e7b90d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.598758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc51d04-c6d3-4412-93d9-1aeb19e7b90d service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.608469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 824/1605] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:48:59.609916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d55ad9-5c11-4235-81d6-6edaf08f4bab None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.610200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d55ad9-5c11-4235-81d6-6edaf08f4bab None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.610450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d55ad9-5c11-4235-81d6-6edaf08f4bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.639276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-97d55ad9-5c11-4235-81d6-6edaf08f4bab None None] MFA Rules not processed for user `fa4d0d66fe2944c983a735e403309d49`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:59.640408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-97d55ad9-5c11-4235-81d6-6edaf08f4bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:59.648917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26ecde-d0e3-4303-8ab9-8fbfb45e29f0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.653429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fcd5c-cda5-4747-9608-5b8e379048b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.653840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fcd5c-cda5-4747-9608-5b8e379048b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.654121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fcd5c-cda5-4747-9608-5b8e379048b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.654395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fcd5c-cda5-4747-9608-5b8e379048b3 admin admin] PATH_INFO: `/v3/projects/b9ca774a62914ed1ab7af85f365ad7b0/users/9c932f6c9f8b4e5d8eedfb5b597c0007/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.670604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fcd5c-cda5-4747-9608-5b8e379048b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ca774a62914ed1ab7af85f365ad7b0, user_id=9c932f6c9f8b4e5d8eedfb5b597c0007, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.673287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fcd5c-cda5-4747-9608-5b8e379048b3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.688735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 782/1606] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:48:59 2022] PUT /identity/v3/projects/b9ca774a62914ed1ab7af85f365ad7b0/users/9c932f6c9f8b4e5d8eedfb5b597c0007/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:48:59.690177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fcd5c-cda5-4747-9608-5b8e379048b3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.716154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 825/1607] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:59.720323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d55ad9-5c11-4235-81d6-6edaf08f4bab None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.759890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fcd5c-cda5-4747-9608-5b8e379048b3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.764531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa33c-41c4-48b6-bb6d-8810c2fabd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.765191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa33c-41c4-48b6-bb6d-8810c2fabd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.765471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa33c-41c4-48b6-bb6d-8810c2fabd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.765777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa33c-41c4-48b6-bb6d-8810c2fabd6f admin admin] PATH_INFO: `/v3/projects/88a664ae803041a3a920a94be6463544/users/56887264e355449d9dee481cf2f9f649/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.778570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d55ad9-5c11-4235-81d6-6edaf08f4bab None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.780763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aa33c-41c4-48b6-bb6d-8810c2fabd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a664ae803041a3a920a94be6463544, user_id=56887264e355449d9dee481cf2f9f649, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.783500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aa33c-41c4-48b6-bb6d-8810c2fabd6f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.798013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 783/1608] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:48:59 2022] PUT /identity/v3/projects/88a664ae803041a3a920a94be6463544/users/56887264e355449d9dee481cf2f9f649/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:48:59.801043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ad8d-2bb2-4f4e-b91f-dd7912e0d334 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.801548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ad8d-2bb2-4f4e-b91f-dd7912e0d334 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.802542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ad8d-2bb2-4f4e-b91f-dd7912e0d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.812290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:59.827724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5031ad8d-2bb2-4f4e-b91f-dd7912e0d334 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:59.829100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5031ad8d-2bb2-4f4e-b91f-dd7912e0d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:59.842220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a52c9-34b6-4a63-98ae-d9ec920c7753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.843208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a52c9-34b6-4a63-98ae-d9ec920c7753 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.843517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a52c9-34b6-4a63-98ae-d9ec920c7753 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.843793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a52c9-34b6-4a63-98ae-d9ec920c7753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.854956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a52c9-34b6-4a63-98ae-d9ec920c7753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.857261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a52c9-34b6-4a63-98ae-d9ec920c7753 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.869659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 826/1609] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:48:59.870944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a52c9-34b6-4a63-98ae-d9ec920c7753 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.881990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a52c9-34b6-4a63-98ae-d9ec920c7753 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.882827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:48:59.894303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 784/1610] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:59.896319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eade8b0-4660-469a-8d08-0bcfd495ff6f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.896635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eade8b0-4660-469a-8d08-0bcfd495ff6f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.896930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eade8b0-4660-469a-8d08-0bcfd495ff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.919993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0eade8b0-4660-469a-8d08-0bcfd495ff6f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:59.921224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0eade8b0-4660-469a-8d08-0bcfd495ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:59.930155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 785/1611] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:59.931237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9aceb-7a49-44eb-adeb-16b0d490b5f9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.931559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9aceb-7a49-44eb-adeb-16b0d490b5f9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.931889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9aceb-7a49-44eb-adeb-16b0d490b5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.953193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-69f9aceb-7a49-44eb-adeb-16b0d490b5f9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:48:59.955457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-69f9aceb-7a49-44eb-adeb-16b0d490b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:48:59.967190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 786/1612] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:48:59.967417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b6656-773b-4387-bca8-4406413ee809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.967417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b6656-773b-4387-bca8-4406413ee809 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.967639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9aceb-7a49-44eb-adeb-16b0d490b5f9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:48:59.967856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b6656-773b-4387-bca8-4406413ee809 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.967856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b6656-773b-4387-bca8-4406413ee809 admin admin] PATH_INFO: `/v3/projects/fbb4053e833f456e9d302ab5f761fcba/users/c1309821469549fe82a2c419ef4434d2/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.983635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9aceb-7a49-44eb-adeb-16b0d490b5f9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:48:59.985286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b6656-773b-4387-bca8-4406413ee809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb4053e833f456e9d302ab5f761fcba, user_id=c1309821469549fe82a2c419ef4434d2, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.988059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b6656-773b-4387-bca8-4406413ee809 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:48:59.989397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec84b-d346-4251-ae1e-81ee75f45eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:48:59.991012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec84b-d346-4251-ae1e-81ee75f45eef admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:48:59.991475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec84b-d346-4251-ae1e-81ee75f45eef admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:48:59.992427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec84b-d346-4251-ae1e-81ee75f45eef admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:48:59.993706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec84b-d346-4251-ae1e-81ee75f45eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:48:59.996263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec84b-d346-4251-ae1e-81ee75f45eef admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.003418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 827/1613] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:48:59 2022] PUT /identity/v3/projects/fbb4053e833f456e9d302ab5f761fcba/users/c1309821469549fe82a2c419ef4434d2/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:00.005128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165d9e-8d95-4352-9604-78ad67e7e528 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.005421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165d9e-8d95-4352-9604-78ad67e7e528 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.005751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165d9e-8d95-4352-9604-78ad67e7e528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.032026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 787/1614] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:48:59 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:00.033520 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6fa16-ca1d-4cdc-bd1d-0e2a5b9d5f0d None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.033771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6fa16-ca1d-4cdc-bd1d-0e2a5b9d5f0d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.034359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6fa16-ca1d-4cdc-bd1d-0e2a5b9d5f0d None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.036577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cb165d9e-8d95-4352-9604-78ad67e7e528 None None] MFA Rules not processed for user `56887264e355449d9dee481cf2f9f649`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:00.037009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 788/1615] 10.222.0.30 () {54 vars in 912 bytes} [Tue Oct 4 12:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:00.038375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cb165d9e-8d95-4352-9604-78ad67e7e528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:00.038833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6fa16-ca1d-4cdc-bd1d-0e2a5b9d5f0d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.041296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-47b6fa16-ca1d-4cdc-bd1d-0e2a5b9d5f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:00.114278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6fa16-ca1d-4cdc-bd1d-0e2a5b9d5f0d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.118645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 828/1616] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:00.118819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e97700-1114-45dc-a26c-35ce31d46c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.119278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97700-1114-45dc-a26c-35ce31d46c67 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.119591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97700-1114-45dc-a26c-35ce31d46c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.119846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e97700-1114-45dc-a26c-35ce31d46c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.122506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165d9e-8d95-4352-9604-78ad67e7e528 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.132214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165d9e-8d95-4352-9604-78ad67e7e528 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.138064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a86ea-3ed7-4c05-bdb9-9b662645eccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.138678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a86ea-3ed7-4c05-bdb9-9b662645eccc service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.138952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a86ea-3ed7-4c05-bdb9-9b662645eccc service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.139221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a86ea-3ed7-4c05-bdb9-9b662645eccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.190909 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:00.204577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e97700-1114-45dc-a26c-35ce31d46c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.206355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e97700-1114-45dc-a26c-35ce31d46c67 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.215859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a86ea-3ed7-4c05-bdb9-9b662645eccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.217648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a86ea-3ed7-4c05-bdb9-9b662645eccc service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.218199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 789/1617] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:00.219729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e97700-1114-45dc-a26c-35ce31d46c67 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.230818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e97700-1114-45dc-a26c-35ce31d46c67 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.231409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 829/1618] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:00.232951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3df9-c626-4c30-b401-1aba4f0a3a53 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.233434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3df9-c626-4c30-b401-1aba4f0a3a53 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.234012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3df9-c626-4c30-b401-1aba4f0a3a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.234891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6997042-e004-4b1a-b57f-e986d995025c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.235525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997042-e004-4b1a-b57f-e986d995025c service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.235805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997042-e004-4b1a-b57f-e986d995025c service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.236087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997042-e004-4b1a-b57f-e986d995025c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.247615 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6997042-e004-4b1a-b57f-e986d995025c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.249139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6997042-e004-4b1a-b57f-e986d995025c service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.262170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 790/1619] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:00.262844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6997042-e004-4b1a-b57f-e986d995025c service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.274955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f4fa3df9-c626-4c30-b401-1aba4f0a3a53 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:00.277003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f4fa3df9-c626-4c30-b401-1aba4f0a3a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:00.278963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6997042-e004-4b1a-b57f-e986d995025c service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.286693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e619d-3cf7-4b52-90f5-7a3727b7cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.288077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e619d-3cf7-4b52-90f5-7a3727b7cc7a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.291451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e619d-3cf7-4b52-90f5-7a3727b7cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.291451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e619d-3cf7-4b52-90f5-7a3727b7cc7a admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.291690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 830/1620] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:00.291789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e619d-3cf7-4b52-90f5-7a3727b7cc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.291867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e3f9-f468-49b5-838e-0c3c955aa30e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.291867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e3f9-f468-49b5-838e-0c3c955aa30e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.291867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e3f9-f468-49b5-838e-0c3c955aa30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.292292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e619d-3cf7-4b52-90f5-7a3727b7cc7a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.314496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-36c3e3f9-f468-49b5-838e-0c3c955aa30e None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:00.315866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-36c3e3f9-f468-49b5-838e-0c3c955aa30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:00.326217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 791/1621] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:00 2022] POST /identity/v3/users => generated 292 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:00.328497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e619d-3cf7-4b52-90f5-7a3727b7cc7a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.375538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e619d-3cf7-4b52-90f5-7a3727b7cc7a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.384450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6008a6-8746-445d-85df-e58f0e1c5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.386926 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6008a6-8746-445d-85df-e58f0e1c5534 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.387594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6008a6-8746-445d-85df-e58f0e1c5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.388012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6008a6-8746-445d-85df-e58f0e1c5534 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.389029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6008a6-8746-445d-85df-e58f0e1c5534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.392074 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6008a6-8746-445d-85df-e58f0e1c5534 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.414246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 831/1622] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:00.415146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3e3f9-f468-49b5-838e-0c3c955aa30e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.432143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3e3f9-f468-49b5-838e-0c3c955aa30e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.438095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467588d-1c69-40a4-b946-07a2e9d6a102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.438763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467588d-1c69-40a4-b946-07a2e9d6a102 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.439085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467588d-1c69-40a4-b946-07a2e9d6a102 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.439361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467588d-1c69-40a4-b946-07a2e9d6a102 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.440521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467588d-1c69-40a4-b946-07a2e9d6a102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.442652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467588d-1c69-40a4-b946-07a2e9d6a102 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.453076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 792/1623] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:00 2022] POST /identity/v3/projects => generated 355 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:00.457737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 832/1624] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:00.457737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467588d-1c69-40a4-b946-07a2e9d6a102 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.462025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6008a6-8746-445d-85df-e58f0e1c5534 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.473309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467588d-1c69-40a4-b946-07a2e9d6a102 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.516059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:00.549234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86c9b4-4fe3-44b6-9e46-77f975f7b1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.549925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c9b4-4fe3-44b6-9e46-77f975f7b1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.550209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c9b4-4fe3-44b6-9e46-77f975f7b1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.550487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c9b4-4fe3-44b6-9e46-77f975f7b1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.586526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6008a6-8746-445d-85df-e58f0e1c5534 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.590692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4740b-a7a2-4410-983b-521c3d9fdf67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.591321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4740b-a7a2-4410-983b-521c3d9fdf67 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.591605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4740b-a7a2-4410-983b-521c3d9fdf67 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.591910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4740b-a7a2-4410-983b-521c3d9fdf67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.635780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86c9b4-4fe3-44b6-9e46-77f975f7b1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.637535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86c9b4-4fe3-44b6-9e46-77f975f7b1f1 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.654423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 833/1625] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:00.655519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86c9b4-4fe3-44b6-9e46-77f975f7b1f1 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.661665 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:00.669524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86c9b4-4fe3-44b6-9e46-77f975f7b1f1 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.675729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ff74e-46d0-496a-80ec-73a00112a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.676829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff74e-46d0-496a-80ec-73a00112a834 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.677117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff74e-46d0-496a-80ec-73a00112a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.677439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ff74e-46d0-496a-80ec-73a00112a834 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.678500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ff74e-46d0-496a-80ec-73a00112a834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.681937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ff74e-46d0-496a-80ec-73a00112a834 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.712679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 834/1626] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:00 2022] POST /identity/v3/users => generated 284 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:00.712679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ff74e-46d0-496a-80ec-73a00112a834 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.723104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4740b-a7a2-4410-983b-521c3d9fdf67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.724951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ff74e-46d0-496a-80ec-73a00112a834 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.725163 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4740b-a7a2-4410-983b-521c3d9fdf67 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.730992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e198c36-9296-4b85-b2da-41a94cf34553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.731676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198c36-9296-4b85-b2da-41a94cf34553 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.732007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198c36-9296-4b85-b2da-41a94cf34553 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.732293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e198c36-9296-4b85-b2da-41a94cf34553 admin admin] PATH_INFO: `/v3/projects/307290f12d6740ea82699161eee2753c/users/c1573e5a3fe642f281a48c48eb1b464f/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.742992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 793/1627] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:00.744800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4740b-a7a2-4410-983b-521c3d9fdf67 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.768406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e198c36-9296-4b85-b2da-41a94cf34553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307290f12d6740ea82699161eee2753c, user_id=c1573e5a3fe642f281a48c48eb1b464f, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.776953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e198c36-9296-4b85-b2da-41a94cf34553 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.778676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4740b-a7a2-4410-983b-521c3d9fdf67 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.791901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d3c5a-d094-4610-a7cf-061ecf4f01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.792659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3c5a-d094-4610-a7cf-061ecf4f01a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.793017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3c5a-d094-4610-a7cf-061ecf4f01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.793360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3c5a-d094-4610-a7cf-061ecf4f01a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.794684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d3c5a-d094-4610-a7cf-061ecf4f01a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.797075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d3c5a-d094-4610-a7cf-061ecf4f01a0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.802890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 835/1628] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:00 2022] PUT /identity/v3/projects/307290f12d6740ea82699161eee2753c/users/c1573e5a3fe642f281a48c48eb1b464f/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:00.802890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e347d-d1e2-4e63-a48f-bcb04ee0d79a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.802890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e347d-d1e2-4e63-a48f-bcb04ee0d79a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.802890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e347d-d1e2-4e63-a48f-bcb04ee0d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.830716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 794/1629] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:00.830716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d3c5a-d094-4610-a7cf-061ecf4f01a0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.837746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bc9e347d-d1e2-4e63-a48f-bcb04ee0d79a None None] MFA Rules not processed for user `fb62257f963b4287bb20852504d24975`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:00.839023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bc9e347d-d1e2-4e63-a48f-bcb04ee0d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:00.850759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d3c5a-d094-4610-a7cf-061ecf4f01a0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.956783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 836/1630] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:00.961029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e347d-d1e2-4e63-a48f-bcb04ee0d79a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.962023 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f52396-0b46-4ecd-9cdd-0629d7ef18f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.962907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f52396-0b46-4ecd-9cdd-0629d7ef18f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.963413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f52396-0b46-4ecd-9cdd-0629d7ef18f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.964010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f52396-0b46-4ecd-9cdd-0629d7ef18f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:00.965069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f52396-0b46-4ecd-9cdd-0629d7ef18f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:00.968191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f52396-0b46-4ecd-9cdd-0629d7ef18f2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:00.985996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 795/1631] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:00.986615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e347d-d1e2-4e63-a48f-bcb04ee0d79a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:00.987161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f52396-0b46-4ecd-9cdd-0629d7ef18f2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:00.996698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35717622-94f8-4a75-b149-7bb4e7a5e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:00.997394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717622-94f8-4a75-b149-7bb4e7a5e8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:00.997740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717622-94f8-4a75-b149-7bb4e7a5e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:00.998021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35717622-94f8-4a75-b149-7bb4e7a5e8a0 admin admin] PATH_INFO: `/v3/projects/105620f6b6b546c4b447489ca25bada8/users/19ba7e87e92545d282e1aec787459dee/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.008627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f52396-0b46-4ecd-9cdd-0629d7ef18f2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.027110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf36e9-296f-45f7-989d-d6dfa0afc2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:01.027657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35717622-94f8-4a75-b149-7bb4e7a5e8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105620f6b6b546c4b447489ca25bada8, user_id=19ba7e87e92545d282e1aec787459dee, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.027875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf36e9-296f-45f7-989d-d6dfa0afc2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.028163 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf36e9-296f-45f7-989d-d6dfa0afc2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.028566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf36e9-296f-45f7-989d-d6dfa0afc2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.029212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf36e9-296f-45f7-989d-d6dfa0afc2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.031056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35717622-94f8-4a75-b149-7bb4e7a5e8a0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.031197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf36e9-296f-45f7-989d-d6dfa0afc2f2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.053727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 837/1632] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:00 2022] PUT /identity/v3/projects/105620f6b6b546c4b447489ca25bada8/users/19ba7e87e92545d282e1aec787459dee/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:01.055511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35717622-94f8-4a75-b149-7bb4e7a5e8a0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.067049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 796/1633] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:00 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:01.068213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf36e9-296f-45f7-989d-d6dfa0afc2f2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.099719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:01.165715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35717622-94f8-4a75-b149-7bb4e7a5e8a0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.171676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4cdd1-dfbe-41aa-90db-ecee35645b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:01.172569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4cdd1-dfbe-41aa-90db-ecee35645b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.173662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4cdd1-dfbe-41aa-90db-ecee35645b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.174110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4cdd1-dfbe-41aa-90db-ecee35645b5f admin admin] PATH_INFO: `/v3/projects/307290f12d6740ea82699161eee2753c/users/c1573e5a3fe642f281a48c48eb1b464f/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.176610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4cdd1-dfbe-41aa-90db-ecee35645b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=307290f12d6740ea82699161eee2753c, user_id=c1573e5a3fe642f281a48c48eb1b464f, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.183545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4cdd1-dfbe-41aa-90db-ecee35645b5f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.199610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf36e9-296f-45f7-989d-d6dfa0afc2f2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.201473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 838/1634] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:01 2022] PUT /identity/v3/projects/307290f12d6740ea82699161eee2753c/users/c1573e5a3fe642f281a48c48eb1b464f/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:01.202541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4cdd1-dfbe-41aa-90db-ecee35645b5f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.253828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:01.310139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385892-b061-4891-ba5e-887fe0f32048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:01.311144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385892-b061-4891-ba5e-887fe0f32048 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.311622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385892-b061-4891-ba5e-887fe0f32048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.312036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385892-b061-4891-ba5e-887fe0f32048 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.313879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385892-b061-4891-ba5e-887fe0f32048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.315133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4cdd1-dfbe-41aa-90db-ecee35645b5f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.316131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385892-b061-4891-ba5e-887fe0f32048 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.321027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08f336-2c14-4997-a6bf-0f84bdc4bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:01.321709 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08f336-2c14-4997-a6bf-0f84bdc4bd72 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.321999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08f336-2c14-4997-a6bf-0f84bdc4bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.322277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08f336-2c14-4997-a6bf-0f84bdc4bd72 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.323063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08f336-2c14-4997-a6bf-0f84bdc4bd72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.325028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08f336-2c14-4997-a6bf-0f84bdc4bd72 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.339819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 797/1635] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:01.342553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acba42-c6b6-4f51-bf15-660db3d153f0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.342850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acba42-c6b6-4f51-bf15-660db3d153f0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.343128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acba42-c6b6-4f51-bf15-660db3d153f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.355855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 839/1636] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:01 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:01.357878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08f336-2c14-4997-a6bf-0f84bdc4bd72 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.370097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08f336-2c14-4997-a6bf-0f84bdc4bd72 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.376584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148da0af-ad64-4a69-bcad-d5d5d5912ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:01.377586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148da0af-ad64-4a69-bcad-d5d5d5912ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.379414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148da0af-ad64-4a69-bcad-d5d5d5912ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.379414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148da0af-ad64-4a69-bcad-d5d5d5912ef2 admin admin] PATH_INFO: `/v3/projects/105620f6b6b546c4b447489ca25bada8/users/19ba7e87e92545d282e1aec787459dee/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.380574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148da0af-ad64-4a69-bcad-d5d5d5912ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105620f6b6b546c4b447489ca25bada8, user_id=19ba7e87e92545d282e1aec787459dee, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.383813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148da0af-ad64-4a69-bcad-d5d5d5912ef2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.391311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-87acba42-c6b6-4f51-bf15-660db3d153f0 None None] MFA Rules not processed for user `c1573e5a3fe642f281a48c48eb1b464f`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:01.392743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-87acba42-c6b6-4f51-bf15-660db3d153f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:01.398446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 840/1637] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:01 2022] PUT /identity/v3/projects/105620f6b6b546c4b447489ca25bada8/users/19ba7e87e92545d282e1aec787459dee/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:01.399212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148da0af-ad64-4a69-bcad-d5d5d5912ef2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.503577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 798/1638] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:01.505087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687379-fb05-4a26-ad06-096b9d2b6e32 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.505527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687379-fb05-4a26-ad06-096b9d2b6e32 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.507026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687379-fb05-4a26-ad06-096b9d2b6e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.552237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dd687379-fb05-4a26-ad06-096b9d2b6e32 None None] MFA Rules not processed for user `19ba7e87e92545d282e1aec787459dee`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:01.554313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dd687379-fb05-4a26-ad06-096b9d2b6e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:01.574684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148da0af-ad64-4a69-bcad-d5d5d5912ef2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.592658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9adcf-876d-486d-85ba-28b078a5ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:01.593937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9adcf-876d-486d-85ba-28b078a5ebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.594528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9adcf-876d-486d-85ba-28b078a5ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.595165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9adcf-876d-486d-85ba-28b078a5ebe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.596380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9adcf-876d-486d-85ba-28b078a5ebe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.599295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9adcf-876d-486d-85ba-28b078a5ebe6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.618508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:01.625385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 841/1639] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:01.628422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9adcf-876d-486d-85ba-28b078a5ebe6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.661758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 799/1640] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:01.664544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd687379-fb05-4a26-ad06-096b9d2b6e32 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.711697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd687379-fb05-4a26-ad06-096b9d2b6e32 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.725678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3fb9d-f795-44cb-8c80-464c15a0ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:01.730072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3fb9d-f795-44cb-8c80-464c15a0ce65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.731606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3fb9d-f795-44cb-8c80-464c15a0ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.731981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3fb9d-f795-44cb-8c80-464c15a0ce65 admin admin] PATH_INFO: `/v3/projects/43d9f28cbaf84755adcf50bdfbbcf38d/users/aa08896bb38449e083a77aeaf3891ee9/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.780496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3fb9d-f795-44cb-8c80-464c15a0ce65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d9f28cbaf84755adcf50bdfbbcf38d, user_id=aa08896bb38449e083a77aeaf3891ee9, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.785380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3fb9d-f795-44cb-8c80-464c15a0ce65 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.791832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9adcf-876d-486d-85ba-28b078a5ebe6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.800287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ced981-7685-4142-9681-f93731856b6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:01.800907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced981-7685-4142-9681-f93731856b6f service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:01.801195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced981-7685-4142-9681-f93731856b6f service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:01.801496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced981-7685-4142-9681-f93731856b6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:01.828000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 800/1641] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:01 2022] PUT /identity/v3/projects/43d9f28cbaf84755adcf50bdfbbcf38d/users/aa08896bb38449e083a77aeaf3891ee9/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:01.832504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3fb9d-f795-44cb-8c80-464c15a0ce65 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.848861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ced981-7685-4142-9681-f93731856b6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:01.852400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ced981-7685-4142-9681-f93731856b6f service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:01.877998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 842/1642] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:01.879755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ced981-7685-4142-9681-f93731856b6f service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:01.912265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ced981-7685-4142-9681-f93731856b6f service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:01.991189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3fb9d-f795-44cb-8c80-464c15a0ce65 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:02.002527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f96e39-c700-4074-a8e4-73c4611a50a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:02.003467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f96e39-c700-4074-a8e4-73c4611a50a1 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.006604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f96e39-c700-4074-a8e4-73c4611a50a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.006769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f96e39-c700-4074-a8e4-73c4611a50a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.007279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:02.060270 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b7ce-add9-4e28-aa97-349b2e60e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:02.060917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b7ce-add9-4e28-aa97-349b2e60e66e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.061189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b7ce-add9-4e28-aa97-349b2e60e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.061469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b7ce-add9-4e28-aa97-349b2e60e66e admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.062211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6b7ce-add9-4e28-aa97-349b2e60e66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:02.067113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6b7ce-add9-4e28-aa97-349b2e60e66e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:02.090275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 843/1643] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:02.094431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b7ce-add9-4e28-aa97-349b2e60e66e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:02.113655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b7ce-add9-4e28-aa97-349b2e60e66e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:02.127138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a8611-5db4-4c87-a71b-a99b9c8bfebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:02.127834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a8611-5db4-4c87-a71b-a99b9c8bfebc admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.128120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a8611-5db4-4c87-a71b-a99b9c8bfebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.128392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a8611-5db4-4c87-a71b-a99b9c8bfebc admin admin] PATH_INFO: `/v3/projects/43d9f28cbaf84755adcf50bdfbbcf38d/users/aa08896bb38449e083a77aeaf3891ee9/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.132962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a8611-5db4-4c87-a71b-a99b9c8bfebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d9f28cbaf84755adcf50bdfbbcf38d, user_id=aa08896bb38449e083a77aeaf3891ee9, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:02.136985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a8611-5db4-4c87-a71b-a99b9c8bfebc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:02.152212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f96e39-c700-4074-a8e4-73c4611a50a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:02.154716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f96e39-c700-4074-a8e4-73c4611a50a1 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:02.165073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 844/1644] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:02 2022] PUT /identity/v3/projects/43d9f28cbaf84755adcf50bdfbbcf38d/users/aa08896bb38449e083a77aeaf3891ee9/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:02.196692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 801/1645] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:02.418701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a8611-5db4-4c87-a71b-a99b9c8bfebc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:02.499657 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e056-af4a-46eb-9cc6-580006335451 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.500258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e056-af4a-46eb-9cc6-580006335451 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.500258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e056-af4a-46eb-9cc6-580006335451 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.504582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 802/1646] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 4 12:49:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:02.513231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f021-a1d7-4304-94bd-c11c7d18d75e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.513809 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f021-a1d7-4304-94bd-c11c7d18d75e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.514266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f021-a1d7-4304-94bd-c11c7d18d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.544479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9e71f021-a1d7-4304-94bd-c11c7d18d75e None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:02.544479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9e71f021-a1d7-4304-94bd-c11c7d18d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:02.554105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a8611-5db4-4c87-a71b-a99b9c8bfebc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:02.563280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200fc16-6eae-46f9-a96e-5d16f6c9d64f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:02.564031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200fc16-6eae-46f9-a96e-5d16f6c9d64f service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.564562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200fc16-6eae-46f9-a96e-5d16f6c9d64f service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.564977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200fc16-6eae-46f9-a96e-5d16f6c9d64f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.656268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:02.679919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200fc16-6eae-46f9-a96e-5d16f6c9d64f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:02.681636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 803/1647] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 4 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:02.683064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18145e30-dfca-446e-be63-774c2a5e28fe None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.683419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18145e30-dfca-446e-be63-774c2a5e28fe None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.683705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18145e30-dfca-446e-be63-774c2a5e28fe None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.683846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200fc16-6eae-46f9-a96e-5d16f6c9d64f service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:02.689210 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 804/1648] 10.222.0.30 () {54 vars in 912 bytes} [Tue Oct 4 12:49:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:02.690650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e7c1-f2ae-43b0-b036-49d2ab212f4d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.690939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e7c1-f2ae-43b0-b036-49d2ab212f4d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.691218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e7c1-f2ae-43b0-b036-49d2ab212f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.709635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 845/1649] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:02.716668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-83c7e7c1-f2ae-43b0-b036-49d2ab212f4d None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:02.718057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-83c7e7c1-f2ae-43b0-b036-49d2ab212f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:02.732384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 805/1650] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:02.766387 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200fc16-6eae-46f9-a96e-5d16f6c9d64f service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:02.785525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200fc16-6eae-46f9-a96e-5d16f6c9d64f service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:02.791771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec742cc-7fb5-451c-a81e-0a80591b50ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:02.792406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec742cc-7fb5-451c-a81e-0a80591b50ba service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:02.795308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec742cc-7fb5-451c-a81e-0a80591b50ba service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:02.795611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec742cc-7fb5-451c-a81e-0a80591b50ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:02.818313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec742cc-7fb5-451c-a81e-0a80591b50ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:02.820318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec742cc-7fb5-451c-a81e-0a80591b50ba service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:02.847777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 846/1651] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:03.017874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7e7c1-f2ae-43b0-b036-49d2ab212f4d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:03.143464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7e7c1-f2ae-43b0-b036-49d2ab212f4d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:03.150180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:03.151670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:03.152138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:03.152542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] PATH_INFO: `/v3/users/fa4d0d66fe2944c983a735e403309d49` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:03.154407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4d0d66fe2944c983a735e403309d49)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:03.156185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: WARNING py.warnings [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:49:03.156185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: warnings.warn(msg) Oct 04 12:49:03.156185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: Oct 04 12:49:03.161804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:03.304167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4d0d66fe2944c983a735e403309d49'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:03.331003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4d0d66fe2944c983a735e403309d49'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:03.331003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4d0d66fe2944c983a735e403309d49'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:03.331003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4d0d66fe2944c983a735e403309d49'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:03.342438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4d0d66fe2944c983a735e403309d49'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:03.381747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 806/1652] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:03 2022] DELETE /identity/v3/users/fa4d0d66fe2944c983a735e403309d49 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:03.386358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1909-f8bb-482c-abd7-929caa3e9c00 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:03.386689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1909-f8bb-482c-abd7-929caa3e9c00 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:03.386965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1909-f8bb-482c-abd7-929caa3e9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:03.414907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b8dd1909-f8bb-482c-abd7-929caa3e9c00 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:03.417831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b8dd1909-f8bb-482c-abd7-929caa3e9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:03.529794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:03.551972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 847/1653] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:03.580689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:03.582505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:03.762650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06a8a4-8cb7-4e5b-811b-9254cd5c7b45 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:03.768947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497662-7f3b-499a-9510-0875ba3e83fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:03.770162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497662-7f3b-499a-9510-0875ba3e83fa service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:03.771080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497662-7f3b-499a-9510-0875ba3e83fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:03.771588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497662-7f3b-499a-9510-0875ba3e83fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:03.787111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c497662-7f3b-499a-9510-0875ba3e83fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:03.790130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c497662-7f3b-499a-9510-0875ba3e83fa service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:03.805788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 807/1654] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:05.637183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd1909-f8bb-482c-abd7-929caa3e9c00 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:05.641138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b8dd1909-f8bb-482c-abd7-929caa3e9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:05.659755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd1909-f8bb-482c-abd7-929caa3e9c00 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:05.665113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:05.666058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:05.666556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:05.670320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] PATH_INFO: `/v3/users/9189ff7b40604c5ba6848678cc356e41` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:05.672088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9189ff7b40604c5ba6848678cc356e41)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:05.674294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:05.783632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9189ff7b40604c5ba6848678cc356e41'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:05.785429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9189ff7b40604c5ba6848678cc356e41'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:05.808055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9189ff7b40604c5ba6848678cc356e41'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:05.811197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9189ff7b40604c5ba6848678cc356e41'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:05.838722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9189ff7b40604c5ba6848678cc356e41'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:05.876083 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 848/1655] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:05 2022] DELETE /identity/v3/users/9189ff7b40604c5ba6848678cc356e41 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:05.877107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83dda-6a68-4422-982c-3cc7ca26d889 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:05.878034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83dda-6a68-4422-982c-3cc7ca26d889 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:05.878332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83dda-6a68-4422-982c-3cc7ca26d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:05.915875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1de83dda-6a68-4422-982c-3cc7ca26d889 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:05.918945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1de83dda-6a68-4422-982c-3cc7ca26d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:05.935437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:06.088048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 808/1656] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:06.193756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:06.195305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:06.307086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450201d-b4fd-49ce-91ec-4a0694e941eb None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:06.307356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450201d-b4fd-49ce-91ec-4a0694e941eb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:06.307640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450201d-b4fd-49ce-91ec-4a0694e941eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:06.363184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7450201d-b4fd-49ce-91ec-4a0694e941eb None None] MFA Rules not processed for user `aa08896bb38449e083a77aeaf3891ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:06.364476 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7450201d-b4fd-49ce-91ec-4a0694e941eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:06.378803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe62c7-5fd7-41f5-a6df-48e312f35fe8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:06.388776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:06.389472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:06.389760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:06.390138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:06.431771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:06.433329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:06.463185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 849/1657] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:06.463185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:06.466089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:06.505018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128eadd-1a3a-4a4a-8277-c6eee36a5433 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:06.520185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:06.521114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:06.521400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:06.522667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] PATH_INFO: `/v3/projects/94a2428d1ece4a67870f17d638748bf3` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:06.526539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a2428d1ece4a67870f17d638748bf3)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:06.527586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: WARNING py.warnings [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 12:49:06.527586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: warnings.warn(msg) Oct 04 12:49:06.527586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: Oct 04 12:49:06.528799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:06.538319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 809/1658] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:06 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:06.658442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a2428d1ece4a67870f17d638748bf3', 'request_id': 'req-e7ea1e48-26f0-4546-925c-9d58a22797d4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:06.669987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a2428d1ece4a67870f17d638748bf3', 'request_id': 'req-e7ea1e48-26f0-4546-925c-9d58a22797d4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:06.702973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a2428d1ece4a67870f17d638748bf3', 'request_id': 'req-e7ea1e48-26f0-4546-925c-9d58a22797d4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:06.717528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:06.726242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] The token cache is being invalidate because project 94a2428d1ece4a67870f17d638748bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:06.727160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:06.736305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:06.738348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 850/1659] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:06 2022] DELETE /identity/v3/projects/94a2428d1ece4a67870f17d638748bf3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:06.742759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450201d-b4fd-49ce-91ec-4a0694e941eb None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:06.761991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450201d-b4fd-49ce-91ec-4a0694e941eb None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:06.877078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:06.878993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:06.880194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:06.880827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] PATH_INFO: `/v3/users/c1573e5a3fe642f281a48c48eb1b464f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:06.883002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1573e5a3fe642f281a48c48eb1b464f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:06.887872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:06.965737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:06.984133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1573e5a3fe642f281a48c48eb1b464f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:06.985677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1573e5a3fe642f281a48c48eb1b464f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:07.002465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1573e5a3fe642f281a48c48eb1b464f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:07.003609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1573e5a3fe642f281a48c48eb1b464f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:07.016182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b65b028b-c6ce-4715-bd55-3f4794ff8ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1573e5a3fe642f281a48c48eb1b464f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:07.062292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 810/1660] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:06 2022] DELETE /identity/v3/users/c1573e5a3fe642f281a48c48eb1b464f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:07.823554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:07.825624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:07.846003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea1e48-26f0-4546-925c-9d58a22797d4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:07.958232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:07.959320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:07.959783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:07.960199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] PATH_INFO: `/v3/projects/24a6736725664e70949e70f7f61843cb` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:07.961674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a6736725664e70949e70f7f61843cb)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:07.963789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:08.088080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a6736725664e70949e70f7f61843cb', 'request_id': 'req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:08.105276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a6736725664e70949e70f7f61843cb', 'request_id': 'req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:08.124320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a6736725664e70949e70f7f61843cb', 'request_id': 'req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:08.148636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] The token cache is being invalidate because project 24a6736725664e70949e70f7f61843cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:08.149009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:08.149704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b06ec256-e39e-41e9-ae2b-3ece61cae7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:08.153759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 851/1661] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:07 2022] DELETE /identity/v3/projects/24a6736725664e70949e70f7f61843cb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:08.157674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605921-fe7b-4b42-af50-6b9343c6f4b8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:08.163340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605921-fe7b-4b42-af50-6b9343c6f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:08.163910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605921-fe7b-4b42-af50-6b9343c6f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:08.201377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e9605921-fe7b-4b42-af50-6b9343c6f4b8 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:08.202754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e9605921-fe7b-4b42-af50-6b9343c6f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:08.348377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 811/1662] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:08.354382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9a66-8763-4f95-b58d-f539b40201c3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:08.354941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9a66-8763-4f95-b58d-f539b40201c3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:08.356029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9a66-8763-4f95-b58d-f539b40201c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:08.424392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4ebd9a66-8763-4f95-b58d-f539b40201c3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:08.424392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4ebd9a66-8763-4f95-b58d-f539b40201c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:08.438416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 852/1663] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:08.442588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9605921-fe7b-4b42-af50-6b9343c6f4b8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:08.456981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9605921-fe7b-4b42-af50-6b9343c6f4b8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:08.478065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:08.478621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:08.478897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:08.479169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:08.486747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:08.502791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:08.509291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:08.548796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 812/1664] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:49:08.554366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9a66-8763-4f95-b58d-f539b40201c3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:08.565075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9a66-8763-4f95-b58d-f539b40201c3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:08.596802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:08.597778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:08.598728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:08.598728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:08.599418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:08.602698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:08.684196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 853/1665] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:08 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:08.688960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:08.712115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb1a1-c021-4cbb-8160-3978644b30ae admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:08.840515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:08.844508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:08.909978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79621-2e89-4921-87a2-8132a001756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:08.910709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79621-2e89-4921-87a2-8132a001756b admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:08.911307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79621-2e89-4921-87a2-8132a001756b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:08.911658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79621-2e89-4921-87a2-8132a001756b admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:08.913824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b79621-2e89-4921-87a2-8132a001756b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:08.916050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b79621-2e89-4921-87a2-8132a001756b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:08.982305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 813/1666] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:08 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:08.983286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79621-2e89-4921-87a2-8132a001756b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:09.014875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79621-2e89-4921-87a2-8132a001756b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:09.068975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33f51a-456b-4c93-8eaf-0bcdfc23c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:09.073101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f51a-456b-4c93-8eaf-0bcdfc23c7fc admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.073723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f51a-456b-4c93-8eaf-0bcdfc23c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.074527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33f51a-456b-4c93-8eaf-0bcdfc23c7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.075740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33f51a-456b-4c93-8eaf-0bcdfc23c7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:09.084951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33f51a-456b-4c93-8eaf-0bcdfc23c7fc admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:09.105127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc26b-3b15-49a0-841e-5efdede4a65e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:09.126749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:09.128104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.128594 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.129441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] PATH_INFO: `/v3/projects/307290f12d6740ea82699161eee2753c` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.133791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=307290f12d6740ea82699161eee2753c)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:09.139055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 814/1667] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:09.142476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:09.143766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33f51a-456b-4c93-8eaf-0bcdfc23c7fc admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:09.149241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:09.185342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33f51a-456b-4c93-8eaf-0bcdfc23c7fc admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:09.213159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54892e75-1d59-4f73-9170-6e2848c7aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:09.214088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892e75-1d59-4f73-9170-6e2848c7aabe admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.214653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892e75-1d59-4f73-9170-6e2848c7aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.215072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54892e75-1d59-4f73-9170-6e2848c7aabe admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.215863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54892e75-1d59-4f73-9170-6e2848c7aabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:09.224019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54892e75-1d59-4f73-9170-6e2848c7aabe admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:09.303600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 815/1668] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:09.306434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54892e75-1d59-4f73-9170-6e2848c7aabe admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:09.331136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307290f12d6740ea82699161eee2753c', 'request_id': 'req-308365c9-6a55-4389-9e65-44527de10145'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:09.346126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307290f12d6740ea82699161eee2753c', 'request_id': 'req-308365c9-6a55-4389-9e65-44527de10145'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:09.355273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54892e75-1d59-4f73-9170-6e2848c7aabe admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:09.360168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307290f12d6740ea82699161eee2753c', 'request_id': 'req-308365c9-6a55-4389-9e65-44527de10145'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:09.391842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:09.409975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] The token cache is being invalidate because project 307290f12d6740ea82699161eee2753c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:09.410787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:09.411611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-308365c9-6a55-4389-9e65-44527de10145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:09.417120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 854/1669] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:08 2022] DELETE /identity/v3/projects/307290f12d6740ea82699161eee2753c => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:09.424451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805a7d-5f53-4b28-af72-c6ceed44a92a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.424451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805a7d-5f53-4b28-af72-c6ceed44a92a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.424451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805a7d-5f53-4b28-af72-c6ceed44a92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.469572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-52805a7d-5f53-4b28-af72-c6ceed44a92a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:09.470862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-52805a7d-5f53-4b28-af72-c6ceed44a92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:09.556458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad23bd-a85e-42b8-8f2e-0c6f9694a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:09.557155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad23bd-a85e-42b8-8f2e-0c6f9694a6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.557432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad23bd-a85e-42b8-8f2e-0c6f9694a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.560198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad23bd-a85e-42b8-8f2e-0c6f9694a6eb admin admin] PATH_INFO: `/v3/projects/bf2c97bbc52d43e4b0bace506b9b899f/users/87a1726291bc4fbc89694b92294a89bf/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.604540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad23bd-a85e-42b8-8f2e-0c6f9694a6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2c97bbc52d43e4b0bace506b9b899f, user_id=87a1726291bc4fbc89694b92294a89bf, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:09.607605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad23bd-a85e-42b8-8f2e-0c6f9694a6eb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:09.633384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 816/1670] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:09 2022] PUT /identity/v3/projects/bf2c97bbc52d43e4b0bace506b9b899f/users/87a1726291bc4fbc89694b92294a89bf/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:09.645841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3a37d-3bc2-4233-a4ce-879a48847e83 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.647419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3a37d-3bc2-4233-a4ce-879a48847e83 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.647703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3a37d-3bc2-4233-a4ce-879a48847e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.675318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 855/1671] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:09.683630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdabdf1-99df-40e3-8fe1-a835158e9331 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.684692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdabdf1-99df-40e3-8fe1-a835158e9331 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.684973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdabdf1-99df-40e3-8fe1-a835158e9331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.690249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6ad3a37d-3bc2-4233-a4ce-879a48847e83 None None] MFA Rules not processed for user `87a1726291bc4fbc89694b92294a89bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:09.691483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6ad3a37d-3bc2-4233-a4ce-879a48847e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:09.749080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-efdabdf1-99df-40e3-8fe1-a835158e9331 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:09.754035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-efdabdf1-99df-40e3-8fe1-a835158e9331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:09.860027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 856/1672] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:09.864399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 817/1673] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:09.866191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3a37d-3bc2-4233-a4ce-879a48847e83 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:09.866329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdabdf1-99df-40e3-8fe1-a835158e9331 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:09.867802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6ad3a37d-3bc2-4233-a4ce-879a48847e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:09.892065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdabdf1-99df-40e3-8fe1-a835158e9331 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:09.902425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3a37d-3bc2-4233-a4ce-879a48847e83 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:09.907316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baad5fa-ecfa-4305-9cf9-a01204f087ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:09.908044 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baad5fa-ecfa-4305-9cf9-a01204f087ee admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.908568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baad5fa-ecfa-4305-9cf9-a01204f087ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.908850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baad5fa-ecfa-4305-9cf9-a01204f087ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.909749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baad5fa-ecfa-4305-9cf9-a01204f087ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:09.910295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:09.911163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:09.911650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:09.913118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baad5fa-ecfa-4305-9cf9-a01204f087ee admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:09.913479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:09.914382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:09.914907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:09.918206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:09.943141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 857/1674] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:09.950981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:09.970789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 818/1675] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:09 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:09.975490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baad5fa-ecfa-4305-9cf9-a01204f087ee admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:09.985232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f1f9c-d083-4c4a-bdf4-62216d09f30e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:10.034984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:10.133133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baad5fa-ecfa-4305-9cf9-a01204f087ee admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:10.141850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb314c-9d6d-4e89-b3f3-3deddf9cec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:10.143307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb314c-9d6d-4e89-b3f3-3deddf9cec9d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:10.143593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb314c-9d6d-4e89-b3f3-3deddf9cec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:10.143871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb314c-9d6d-4e89-b3f3-3deddf9cec9d admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:10.145013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0b221-b13c-46b6-8d41-56927188bf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:10.146124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb314c-9d6d-4e89-b3f3-3deddf9cec9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:10.148622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0b221-b13c-46b6-8d41-56927188bf16 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:10.148917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0b221-b13c-46b6-8d41-56927188bf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:10.149194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0b221-b13c-46b6-8d41-56927188bf16 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:10.150032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0b221-b13c-46b6-8d41-56927188bf16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:10.152236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb314c-9d6d-4e89-b3f3-3deddf9cec9d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:10.153793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0b221-b13c-46b6-8d41-56927188bf16 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:10.188490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:10.244730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 819/1676] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:09 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:10.250071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 858/1677] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:09 2022] POST /identity/v3/projects => generated 367 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:10.250764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0b221-b13c-46b6-8d41-56927188bf16 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:10.253784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb314c-9d6d-4e89-b3f3-3deddf9cec9d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:10.306818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0b221-b13c-46b6-8d41-56927188bf16 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:10.579882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb314c-9d6d-4e89-b3f3-3deddf9cec9d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:10.596750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0da4d-6621-453c-a2d5-6feb2ff9e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:10.597345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0da4d-6621-453c-a2d5-6feb2ff9e9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:10.597650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0da4d-6621-453c-a2d5-6feb2ff9e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:10.597930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0da4d-6621-453c-a2d5-6feb2ff9e9d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:10.598584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0da4d-6621-453c-a2d5-6feb2ff9e9d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:10.600614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0da4d-6621-453c-a2d5-6feb2ff9e9d3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:10.618200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a6612-789f-437f-a38d-4cfcfa6c5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:10.618847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6612-789f-437f-a38d-4cfcfa6c5f5d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:10.619132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6612-789f-437f-a38d-4cfcfa6c5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:10.619403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6612-789f-437f-a38d-4cfcfa6c5f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:10.620066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a6612-789f-437f-a38d-4cfcfa6c5f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:10.643231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a6612-789f-437f-a38d-4cfcfa6c5f5d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:10.688297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 820/1678] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:10.691067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a6612-789f-437f-a38d-4cfcfa6c5f5d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:10.712391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 859/1679] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:10 2022] POST /identity/v3/users => generated 284 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:10.719252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0da4d-6621-453c-a2d5-6feb2ff9e9d3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:10.735850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a6612-789f-437f-a38d-4cfcfa6c5f5d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:10.755863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0da4d-6621-453c-a2d5-6feb2ff9e9d3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:10.761134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827cf62-0913-4cc0-a3f2-918b9539b17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:10.763923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827cf62-0913-4cc0-a3f2-918b9539b17e admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:10.770553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827cf62-0913-4cc0-a3f2-918b9539b17e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:10.772485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827cf62-0913-4cc0-a3f2-918b9539b17e admin admin] PATH_INFO: `/v3/projects/00b8e9a7b7154b36bfc4699f4f52f632/users/6c2c2852bde34e17b62e5bf01b4886ca/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:10.793101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d91bea-a64d-45b5-9c2c-0a409aa9727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:10.794367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d91bea-a64d-45b5-9c2c-0a409aa9727a admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:10.797410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d91bea-a64d-45b5-9c2c-0a409aa9727a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:10.797933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d91bea-a64d-45b5-9c2c-0a409aa9727a admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:10.801249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d91bea-a64d-45b5-9c2c-0a409aa9727a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:10.814263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d91bea-a64d-45b5-9c2c-0a409aa9727a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:10.832992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827cf62-0913-4cc0-a3f2-918b9539b17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b8e9a7b7154b36bfc4699f4f52f632, user_id=6c2c2852bde34e17b62e5bf01b4886ca, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:10.839405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827cf62-0913-4cc0-a3f2-918b9539b17e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:10.840193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 860/1680] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:10.841200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d91bea-a64d-45b5-9c2c-0a409aa9727a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:10.868530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d91bea-a64d-45b5-9c2c-0a409aa9727a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:10.875906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 821/1681] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:10 2022] PUT /identity/v3/projects/00b8e9a7b7154b36bfc4699f4f52f632/users/6c2c2852bde34e17b62e5bf01b4886ca/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:10.881524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827cf62-0913-4cc0-a3f2-918b9539b17e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:11.043698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab498-d0ef-461b-9d6a-de7b37e43469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:11.044572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab498-d0ef-461b-9d6a-de7b37e43469 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.045805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab498-d0ef-461b-9d6a-de7b37e43469 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.046913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab498-d0ef-461b-9d6a-de7b37e43469 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.048965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ab498-d0ef-461b-9d6a-de7b37e43469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:11.053207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827cf62-0913-4cc0-a3f2-918b9539b17e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:11.062782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ab498-d0ef-461b-9d6a-de7b37e43469 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:11.071827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077991f1-8f61-4d1e-9943-a199b1bedc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:11.072469 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077991f1-8f61-4d1e-9943-a199b1bedc54 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.072752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077991f1-8f61-4d1e-9943-a199b1bedc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.073028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077991f1-8f61-4d1e-9943-a199b1bedc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.073730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077991f1-8f61-4d1e-9943-a199b1bedc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:11.075511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077991f1-8f61-4d1e-9943-a199b1bedc54 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:11.081703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 861/1682] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:11.083029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab498-d0ef-461b-9d6a-de7b37e43469 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:11.094719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab498-d0ef-461b-9d6a-de7b37e43469 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:11.102405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280634b6-0ce9-45c1-9101-87f04b1b19e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:11.106847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280634b6-0ce9-45c1-9101-87f04b1b19e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.107482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280634b6-0ce9-45c1-9101-87f04b1b19e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.107582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 822/1683] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:11.108060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280634b6-0ce9-45c1-9101-87f04b1b19e8 admin admin] PATH_INFO: `/v3/projects/bbc6fdeb07134e8988d546fb69ec00ec/users/e43c9a8011dc4257891fd3ae1047541f/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.108594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077991f1-8f61-4d1e-9943-a199b1bedc54 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:11.133728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077991f1-8f61-4d1e-9943-a199b1bedc54 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:11.142729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280634b6-0ce9-45c1-9101-87f04b1b19e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc6fdeb07134e8988d546fb69ec00ec, user_id=e43c9a8011dc4257891fd3ae1047541f, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:11.144251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be67e8-d523-4416-a262-a04206fb3bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:11.145115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be67e8-d523-4416-a262-a04206fb3bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.145703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be67e8-d523-4416-a262-a04206fb3bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.145987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be67e8-d523-4416-a262-a04206fb3bf3 admin admin] PATH_INFO: `/v3/projects/00b8e9a7b7154b36bfc4699f4f52f632/users/6c2c2852bde34e17b62e5bf01b4886ca/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.150123 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be67e8-d523-4416-a262-a04206fb3bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b8e9a7b7154b36bfc4699f4f52f632, user_id=6c2c2852bde34e17b62e5bf01b4886ca, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:11.151417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280634b6-0ce9-45c1-9101-87f04b1b19e8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:11.154960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be67e8-d523-4416-a262-a04206fb3bf3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:11.159701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:11.187323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 823/1685] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:11 2022] PUT /identity/v3/projects/00b8e9a7b7154b36bfc4699f4f52f632/users/6c2c2852bde34e17b62e5bf01b4886ca/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:11.190016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 862/1685] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:11 2022] PUT /identity/v3/projects/bbc6fdeb07134e8988d546fb69ec00ec/users/e43c9a8011dc4257891fd3ae1047541f/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:11.191636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e70ec-38e9-4cf8-807b-e797f61a62a5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.192079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e70ec-38e9-4cf8-807b-e797f61a62a5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.192316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e70ec-38e9-4cf8-807b-e797f61a62a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.198529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e11df-ddd7-4b9d-a8b7-b70bfc895205 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.199033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e11df-ddd7-4b9d-a8b7-b70bfc895205 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.199442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e11df-ddd7-4b9d-a8b7-b70bfc895205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.252993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e69e70ec-38e9-4cf8-807b-e797f61a62a5 None None] MFA Rules not processed for user `e43c9a8011dc4257891fd3ae1047541f`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:11.254287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e69e70ec-38e9-4cf8-807b-e797f61a62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:11.267869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5d7e11df-ddd7-4b9d-a8b7-b70bfc895205 None None] MFA Rules not processed for user `6c2c2852bde34e17b62e5bf01b4886ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:11.270718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5d7e11df-ddd7-4b9d-a8b7-b70bfc895205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:11.322975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:11.401811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 824/1686] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:11.406597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e70ec-38e9-4cf8-807b-e797f61a62a5 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:11.443899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 863/1687] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:11.461402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e11df-ddd7-4b9d-a8b7-b70bfc895205 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:11.465437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5d7e11df-ddd7-4b9d-a8b7-b70bfc895205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:11.562431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e70ec-38e9-4cf8-807b-e797f61a62a5 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:11.575408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99460c-e339-4a11-b7ae-1bd74cc73c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:11.578035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99460c-e339-4a11-b7ae-1bd74cc73c41 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.578543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99460c-e339-4a11-b7ae-1bd74cc73c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.579000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99460c-e339-4a11-b7ae-1bd74cc73c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.580472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99460c-e339-4a11-b7ae-1bd74cc73c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:11.587689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99460c-e339-4a11-b7ae-1bd74cc73c41 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:11.626111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e11df-ddd7-4b9d-a8b7-b70bfc895205 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:11.642297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8025b-08ac-4f5b-8a0e-07b9f85010bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:11.648873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8025b-08ac-4f5b-8a0e-07b9f85010bb service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.649259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8025b-08ac-4f5b-8a0e-07b9f85010bb service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.649551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8025b-08ac-4f5b-8a0e-07b9f85010bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.678024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8025b-08ac-4f5b-8a0e-07b9f85010bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:11.679520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8025b-08ac-4f5b-8a0e-07b9f85010bb service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:11.683704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 825/1688] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:11 2022] POST /identity/v3/projects => generated 367 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:11.688726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031089-de45-4e9a-829e-ac8d84fa1374 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.689482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031089-de45-4e9a-829e-ac8d84fa1374 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.692527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031089-de45-4e9a-829e-ac8d84fa1374 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.694379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 826/1689] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:49:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:11.698363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031089-de45-4e9a-829e-ac8d84fa1374 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:11.704526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 864/1690] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:11.739048 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214305e5-6735-4cb6-a8b0-aef89a47a503 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:11.739339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214305e5-6735-4cb6-a8b0-aef89a47a503 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:11.739622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214305e5-6735-4cb6-a8b0-aef89a47a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:11.803035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-214305e5-6735-4cb6-a8b0-aef89a47a503 None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:11.804283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-214305e5-6735-4cb6-a8b0-aef89a47a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:11.982999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031089-de45-4e9a-829e-ac8d84fa1374 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:12.000667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17377757-10b6-4b7f-87df-10ccb4455ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:12.001299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377757-10b6-4b7f-87df-10ccb4455ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:12.001589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377757-10b6-4b7f-87df-10ccb4455ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:12.001970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377757-10b6-4b7f-87df-10ccb4455ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:12.002796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17377757-10b6-4b7f-87df-10ccb4455ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:12.009394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17377757-10b6-4b7f-87df-10ccb4455ca1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:12.033798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 865/1691] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:12.033798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214305e5-6735-4cb6-a8b0-aef89a47a503 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:12.064750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:12.068925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 827/1692] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:11 2022] POST /identity/v3/users => generated 290 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:12.072927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17377757-10b6-4b7f-87df-10ccb4455ca1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:12.105650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17377757-10b6-4b7f-87df-10ccb4455ca1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:12.117996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:12.118643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:12.119190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:12.119472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:12.120131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:12.124532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:12.153094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 828/1693] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:12.154484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:12.158670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:12.207315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b913cb-a331-40d6-a785-100367e3334f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:12.226712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214305e5-6735-4cb6-a8b0-aef89a47a503 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:12.231744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42177-c12f-416b-bbe5-ccd840a3bad1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:12.232420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42177-c12f-416b-bbe5-ccd840a3bad1 service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:12.232773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42177-c12f-416b-bbe5-ccd840a3bad1 service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:12.232970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d42177-c12f-416b-bbe5-ccd840a3bad1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:12.242625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcbc24-b762-414b-bb7e-04e6897c1305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:12.243879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcbc24-b762-414b-bb7e-04e6897c1305 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:12.244175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcbc24-b762-414b-bb7e-04e6897c1305 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:12.244532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcbc24-b762-414b-bb7e-04e6897c1305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:12.259587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d42177-c12f-416b-bbe5-ccd840a3bad1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:12.266749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d42177-c12f-416b-bbe5-ccd840a3bad1 service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:12.300783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 829/1694] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:12.304194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42177-c12f-416b-bbe5-ccd840a3bad1 service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:12.340371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d42177-c12f-416b-bbe5-ccd840a3bad1 service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:12.358356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30db153-5bd6-4513-bd24-1881a3d517cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:12.359389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30db153-5bd6-4513-bd24-1881a3d517cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:12.359536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30db153-5bd6-4513-bd24-1881a3d517cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:12.360103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30db153-5bd6-4513-bd24-1881a3d517cb admin admin] PATH_INFO: `/v3/projects/a72dade5e5944b9aafcf082f121dec09/users/5871e9f6abee4604a49842fa45e0ad05/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:12.390979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30db153-5bd6-4513-bd24-1881a3d517cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72dade5e5944b9aafcf082f121dec09, user_id=5871e9f6abee4604a49842fa45e0ad05, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:12.394437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30db153-5bd6-4513-bd24-1881a3d517cb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:12.394906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcbc24-b762-414b-bb7e-04e6897c1305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:12.396834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcbc24-b762-414b-bb7e-04e6897c1305 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:12.429399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 830/1695] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:12 2022] PUT /identity/v3/projects/a72dade5e5944b9aafcf082f121dec09/users/5871e9f6abee4604a49842fa45e0ad05/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:12.433208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30db153-5bd6-4513-bd24-1881a3d517cb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:12.438597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 866/1696] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:12.458167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:12.650710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30db153-5bd6-4513-bd24-1881a3d517cb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:12.661015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04e8eb-4529-4ad7-9e86-faee4c214213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:12.663242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e8eb-4529-4ad7-9e86-faee4c214213 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:12.663719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e8eb-4529-4ad7-9e86-faee4c214213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:12.664185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04e8eb-4529-4ad7-9e86-faee4c214213 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:12.672712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04e8eb-4529-4ad7-9e86-faee4c214213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:12.679134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04e8eb-4529-4ad7-9e86-faee4c214213 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:12.716041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 831/1697] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:12.719973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcbc24-b762-414b-bb7e-04e6897c1305 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:12.740755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcbc24-b762-414b-bb7e-04e6897c1305 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:12.751857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b0906-55f8-4e47-893b-486500d84d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:12.752551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b0906-55f8-4e47-893b-486500d84d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:12.752840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b0906-55f8-4e47-893b-486500d84d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:12.753115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b0906-55f8-4e47-893b-486500d84d36 admin admin] PATH_INFO: `/v3/projects/a72dade5e5944b9aafcf082f121dec09/users/5871e9f6abee4604a49842fa45e0ad05/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:12.756815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b0906-55f8-4e47-893b-486500d84d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72dade5e5944b9aafcf082f121dec09, user_id=5871e9f6abee4604a49842fa45e0ad05, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:12.759644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b0906-55f8-4e47-893b-486500d84d36 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:12.789590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 867/1698] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:12 2022] PUT /identity/v3/projects/a72dade5e5944b9aafcf082f121dec09/users/5871e9f6abee4604a49842fa45e0ad05/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:12.800102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a909-8639-41e7-af06-86e83bdcc8b2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:12.800370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a909-8639-41e7-af06-86e83bdcc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:12.800650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257a909-8639-41e7-af06-86e83bdcc8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:12.887792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4257a909-8639-41e7-af06-86e83bdcc8b2 None None] MFA Rules not processed for user `5871e9f6abee4604a49842fa45e0ad05`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:12.889368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4257a909-8639-41e7-af06-86e83bdcc8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:13.012769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70053ce-12e8-4236-9f1e-b88de89ddabc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:13.013136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70053ce-12e8-4236-9f1e-b88de89ddabc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:13.013637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70053ce-12e8-4236-9f1e-b88de89ddabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:13.060787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 832/1699] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:13.067761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257a909-8639-41e7-af06-86e83bdcc8b2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:13.071058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4257a909-8639-41e7-af06-86e83bdcc8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:13.083424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f70053ce-12e8-4236-9f1e-b88de89ddabc None None] MFA Rules not processed for user `063da0983af548fe90761a0ddd4f5aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:13.086360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f70053ce-12e8-4236-9f1e-b88de89ddabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:13.212016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257a909-8639-41e7-af06-86e83bdcc8b2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:13.221135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:13.222846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:13.223233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:13.223998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:13.261645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:13.262221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 868/1700] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:13.263869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8284-dc33-451d-bbee-234dd61cdd36 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:13.265570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:13.266013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8284-dc33-451d-bbee-234dd61cdd36 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:13.266400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8284-dc33-451d-bbee-234dd61cdd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:13.297758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 833/1701] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:13.306191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-989b8284-dc33-451d-bbee-234dd61cdd36 None None] MFA Rules not processed for user `063da0983af548fe90761a0ddd4f5aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:13.307476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-989b8284-dc33-451d-bbee-234dd61cdd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:13.324469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 869/1702] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:13.343053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:13.345375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:13.431585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:13.529708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511d4c4-48c6-4976-be9b-d54f323ce25e service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:13.560114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7cce-290c-4f09-9cbd-ceffeb023653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:13.561178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7cce-290c-4f09-9cbd-ceffeb023653 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:13.563333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7cce-290c-4f09-9cbd-ceffeb023653 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:13.563882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7cce-290c-4f09-9cbd-ceffeb023653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:13.598564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d7cce-290c-4f09-9cbd-ceffeb023653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:13.601930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d7cce-290c-4f09-9cbd-ceffeb023653 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:13.618572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 834/1703] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:13.755166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ea5c-7432-48d3-9d27-89e82b208f35 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:13.755480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ea5c-7432-48d3-9d27-89e82b208f35 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:13.756439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ea5c-7432-48d3-9d27-89e82b208f35 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:13.758518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 870/1704] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:13.818280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043013-647b-410e-b1d1-a7d46ed71cec None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:13.818670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043013-647b-410e-b1d1-a7d46ed71cec None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:13.819576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043013-647b-410e-b1d1-a7d46ed71cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:13.867878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e5043013-647b-410e-b1d1-a7d46ed71cec None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:13.871961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e5043013-647b-410e-b1d1-a7d46ed71cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:13.884780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ea5c-7432-48d3-9d27-89e82b208f35 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:13.886708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d592ea5c-7432-48d3-9d27-89e82b208f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:14.042987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:14.105209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ea5c-7432-48d3-9d27-89e82b208f35 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:14.117452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 835/1705] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:49:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:14.118454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:14.119348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:14.121007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:14.121577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] PATH_INFO: `/v3/users/fb62257f963b4287bb20852504d24975` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:14.125860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb62257f963b4287bb20852504d24975)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:14.133676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:14.170710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5043013-647b-410e-b1d1-a7d46ed71cec None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:14.198032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5043013-647b-410e-b1d1-a7d46ed71cec None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:14.218697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01152189-eade-43c4-b146-08e9d99c9cec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:14.219343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152189-eade-43c4-b146-08e9d99c9cec service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:14.220773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152189-eade-43c4-b146-08e9d99c9cec service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:14.221061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01152189-eade-43c4-b146-08e9d99c9cec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:14.274004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01152189-eade-43c4-b146-08e9d99c9cec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:14.277015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01152189-eade-43c4-b146-08e9d99c9cec service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:14.284061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb62257f963b4287bb20852504d24975'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:14.284774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb62257f963b4287bb20852504d24975'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:14.310599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb62257f963b4287bb20852504d24975'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:14.312167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb62257f963b4287bb20852504d24975'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:14.315431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 836/1706] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:14.355746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8bdeafd1-02c5-4436-af60-30170bba8dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb62257f963b4287bb20852504d24975'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:14.408297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 871/1707] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:13 2022] DELETE /identity/v3/users/fb62257f963b4287bb20852504d24975 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:14.761162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d564-9fd5-4f25-aa67-b24ef1378077 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:14.761812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d564-9fd5-4f25-aa67-b24ef1378077 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:14.762097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18d564-9fd5-4f25-aa67-b24ef1378077 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:14.763491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 837/1708] 10.222.0.30 () {54 vars in 912 bytes} [Tue Oct 4 12:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:14.773492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d143-5e5e-468b-baff-6c6190a74a82 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:14.773763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d143-5e5e-468b-baff-6c6190a74a82 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:14.774041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d143-5e5e-468b-baff-6c6190a74a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:14.905209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7fe5d143-5e5e-468b-baff-6c6190a74a82 None None] MFA Rules not processed for user `3e1d9844633a4afaacbb1867b8bbe582`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:14.906428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7fe5d143-5e5e-468b-baff-6c6190a74a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:15.065504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 872/1709] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:49:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:15.162934 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d564-9fd5-4f25-aa67-b24ef1378077 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:15.164570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6f18d564-9fd5-4f25-aa67-b24ef1378077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:15.206735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18d564-9fd5-4f25-aa67-b24ef1378077 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:15.224243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca8da1-2c53-4230-a1b1-a16105d74a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:15.228251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8da1-2c53-4230-a1b1-a16105d74a52 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:15.228740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8da1-2c53-4230-a1b1-a16105d74a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:15.229210 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8da1-2c53-4230-a1b1-a16105d74a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:15.280002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca8da1-2c53-4230-a1b1-a16105d74a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:15.282403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca8da1-2c53-4230-a1b1-a16105d74a52 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:15.310305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 838/1710] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:15.437927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d143-5e5e-468b-baff-6c6190a74a82 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:15.440336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7fe5d143-5e5e-468b-baff-6c6190a74a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:15.649038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:15.659876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d143-5e5e-468b-baff-6c6190a74a82 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:15.689790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:15.690448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:15.690728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:15.690999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] PATH_INFO: `/v3/projects/a71aed1e62d84805b4a0d0418c39c354` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:15.694448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71aed1e62d84805b4a0d0418c39c354)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:15.696382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:15.890081 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71aed1e62d84805b4a0d0418c39c354', 'request_id': 'req-d7b97961-0f3e-44b3-b91f-4b870a5993a7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:15.908122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71aed1e62d84805b4a0d0418c39c354', 'request_id': 'req-d7b97961-0f3e-44b3-b91f-4b870a5993a7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:15.923929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71aed1e62d84805b4a0d0418c39c354', 'request_id': 'req-d7b97961-0f3e-44b3-b91f-4b870a5993a7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:15.954422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] The token cache is being invalidate because project a71aed1e62d84805b4a0d0418c39c354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:15.955536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:15.958975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:15.964239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 873/1711] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:15 2022] DELETE /identity/v3/projects/a71aed1e62d84805b4a0d0418c39c354 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:15.967884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca8da1-2c53-4230-a1b1-a16105d74a52 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:15.984832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca8da1-2c53-4230-a1b1-a16105d74a52 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:16.175836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:16.176744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:16.177273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:16.178265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] PATH_INFO: `/v3/users/aa08896bb38449e083a77aeaf3891ee9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:16.180713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa08896bb38449e083a77aeaf3891ee9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:16.182872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:16.228540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:16.291612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa08896bb38449e083a77aeaf3891ee9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:16.293788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa08896bb38449e083a77aeaf3891ee9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:16.305952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa08896bb38449e083a77aeaf3891ee9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:16.306950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa08896bb38449e083a77aeaf3891ee9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:16.316975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa08896bb38449e083a77aeaf3891ee9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:16.362185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 839/1712] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:15 2022] DELETE /identity/v3/users/aa08896bb38449e083a77aeaf3891ee9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:16.722659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:16.724940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:16.748477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b97961-0f3e-44b3-b91f-4b870a5993a7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:16.959990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:16.960651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:16.960932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:16.961289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] PATH_INFO: `/v3/users/e43c9a8011dc4257891fd3ae1047541f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:16.963682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43c9a8011dc4257891fd3ae1047541f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:16.969122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:16.978529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:16.980300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:17.006235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d5f83-cdf1-4bbb-9aac-02d73758ef46 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:17.019189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:17.020514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:17.020514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:17.020752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] PATH_INFO: `/v3/users/87a1726291bc4fbc89694b92294a89bf` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:17.022505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a1726291bc4fbc89694b92294a89bf)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:17.024301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:17.086131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43c9a8011dc4257891fd3ae1047541f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.090215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43c9a8011dc4257891fd3ae1047541f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.111265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43c9a8011dc4257891fd3ae1047541f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.113361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43c9a8011dc4257891fd3ae1047541f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.133179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a1726291bc4fbc89694b92294a89bf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.135637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a1726291bc4fbc89694b92294a89bf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.145201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43c9a8011dc4257891fd3ae1047541f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.154343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a1726291bc4fbc89694b92294a89bf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.155201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a1726291bc4fbc89694b92294a89bf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.176542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5e9d9657-bd56-45b8-91cd-8b08ec3b589c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a1726291bc4fbc89694b92294a89bf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:17.188431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 874/1713] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:16 2022] DELETE /identity/v3/users/e43c9a8011dc4257891fd3ae1047541f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:17.189441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:17.191035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:17.203918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:17.232614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 840/1714] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:16 2022] DELETE /identity/v3/users/87a1726291bc4fbc89694b92294a89bf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:17.234291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33b782-8111-4074-8b9b-06fd7ccd2619 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:17.234582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33b782-8111-4074-8b9b-06fd7ccd2619 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:17.235038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33b782-8111-4074-8b9b-06fd7ccd2619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:17.257518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fd33b782-8111-4074-8b9b-06fd7ccd2619 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:17.259202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fd33b782-8111-4074-8b9b-06fd7ccd2619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:17.371545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 841/1715] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:17.373912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b061773-68f0-4486-a597-7924db05f47d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:17.374535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78282a0-fec0-4ff7-a2d3-110309879a5c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:17.374987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78282a0-fec0-4ff7-a2d3-110309879a5c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:17.377093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78282a0-fec0-4ff7-a2d3-110309879a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:17.446770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d78282a0-fec0-4ff7-a2d3-110309879a5c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:17.448077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d78282a0-fec0-4ff7-a2d3-110309879a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:17.469184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 842/1716] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:17.470332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78282a0-fec0-4ff7-a2d3-110309879a5c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:17.473213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d78282a0-fec0-4ff7-a2d3-110309879a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:17.489633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:17.564236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:17.569411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:17.572009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:17.573261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:17.579318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:17.615510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:17.617149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:17.625725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78282a0-fec0-4ff7-a2d3-110309879a5c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:17.636559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:17.637341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:17.637753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:17.638517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:17.655765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 875/1717] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:17.656653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:17.663566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:17.667513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:17.681566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c17e5d-5f15-47f2-b203-c3942da344ad service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:17.690808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 843/1718] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:17.696483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049fba2-815f-4f2d-b7b8-c63dfb8038ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:17.697133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049fba2-815f-4f2d-b7b8-c63dfb8038ce service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:17.697423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049fba2-815f-4f2d-b7b8-c63dfb8038ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:17.697740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049fba2-815f-4f2d-b7b8-c63dfb8038ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:17.729773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049fba2-815f-4f2d-b7b8-c63dfb8038ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:17.734011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049fba2-815f-4f2d-b7b8-c63dfb8038ce service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:17.772757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 876/1719] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:18.112086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:18.117460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:18.160993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc0dc4-5ea1-456d-ae11-58af7ae2e162 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:18.175560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:18.176384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:18.177945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:18.181156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] PATH_INFO: `/v3/projects/43d9f28cbaf84755adcf50bdfbbcf38d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:18.184274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d9f28cbaf84755adcf50bdfbbcf38d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:18.188454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:18.315317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d9f28cbaf84755adcf50bdfbbcf38d', 'request_id': 'req-fb493f30-cb96-413a-8c12-5bf32ee16548'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:18.330287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d9f28cbaf84755adcf50bdfbbcf38d', 'request_id': 'req-fb493f30-cb96-413a-8c12-5bf32ee16548'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:18.354119 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d9f28cbaf84755adcf50bdfbbcf38d', 'request_id': 'req-fb493f30-cb96-413a-8c12-5bf32ee16548'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:18.377699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] The token cache is being invalidate because project 43d9f28cbaf84755adcf50bdfbbcf38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:18.378629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:18.380980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fb493f30-cb96-413a-8c12-5bf32ee16548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:18.385423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 844/1720] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:18 2022] DELETE /identity/v3/projects/43d9f28cbaf84755adcf50bdfbbcf38d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:18.391089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b579c-ff8c-451f-9e0f-34665d858a1a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:18.391377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b579c-ff8c-451f-9e0f-34665d858a1a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:18.391651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b579c-ff8c-451f-9e0f-34665d858a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:18.448637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6d5b579c-ff8c-451f-9e0f-34665d858a1a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:18.463771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6d5b579c-ff8c-451f-9e0f-34665d858a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:18.665064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 877/1721] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:18.666307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0710-1579-4f4f-9f68-03521608ef1c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:18.667656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0710-1579-4f4f-9f68-03521608ef1c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:18.667952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0710-1579-4f4f-9f68-03521608ef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:18.721060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-948b0710-1579-4f4f-9f68-03521608ef1c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:18.724896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-948b0710-1579-4f4f-9f68-03521608ef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:18.753743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 845/1722] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:18.758219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b579c-ff8c-451f-9e0f-34665d858a1a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:18.770004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b579c-ff8c-451f-9e0f-34665d858a1a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:18.781040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:18.781797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:18.782140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:18.782480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:18.783212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:18.783579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:18.787020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:18.821174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 878/1723] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:18.822305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b0710-1579-4f4f-9f68-03521608ef1c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:18.841097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b0710-1579-4f4f-9f68-03521608ef1c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:18.851423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b599b80-756d-4fe1-9600-82ea4e81d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:18.852196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599b80-756d-4fe1-9600-82ea4e81d1ca admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:18.852545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599b80-756d-4fe1-9600-82ea4e81d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:18.852929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b599b80-756d-4fe1-9600-82ea4e81d1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:18.853680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b599b80-756d-4fe1-9600-82ea4e81d1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:18.855743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b599b80-756d-4fe1-9600-82ea4e81d1ca admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:18.920859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 846/1724] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:18 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:18.925152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:18.945823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8062a-794d-446b-a09e-d14b4ee681d0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:18.968652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:19.135264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f760a-12af-45f7-8b8f-64d3e4d11171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:19.138354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f760a-12af-45f7-8b8f-64d3e4d11171 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:19.138881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f760a-12af-45f7-8b8f-64d3e4d11171 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:19.139385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f760a-12af-45f7-8b8f-64d3e4d11171 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:19.142362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f760a-12af-45f7-8b8f-64d3e4d11171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:19.148788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f760a-12af-45f7-8b8f-64d3e4d11171 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:19.205241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 879/1725] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:18 2022] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:19.210277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b599b80-756d-4fe1-9600-82ea4e81d1ca admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:19.228838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b599b80-756d-4fe1-9600-82ea4e81d1ca admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:19.245947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd8c81-319f-41fd-9c43-1c4b92d10dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:19.246912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8c81-319f-41fd-9c43-1c4b92d10dbf admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:19.247406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8c81-319f-41fd-9c43-1c4b92d10dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:19.247888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd8c81-319f-41fd-9c43-1c4b92d10dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:19.248764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd8c81-319f-41fd-9c43-1c4b92d10dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:19.250660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd8c81-319f-41fd-9c43-1c4b92d10dbf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:19.274683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 847/1726] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:19.279124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f760a-12af-45f7-8b8f-64d3e4d11171 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:19.290933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f760a-12af-45f7-8b8f-64d3e4d11171 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:19.296601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad218b06-f02c-434a-8f8b-a205ff8695cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:19.296707 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218b06-f02c-434a-8f8b-a205ff8695cc admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:19.296955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218b06-f02c-434a-8f8b-a205ff8695cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:19.297230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218b06-f02c-434a-8f8b-a205ff8695cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:19.297942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad218b06-f02c-434a-8f8b-a205ff8695cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:19.300211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad218b06-f02c-434a-8f8b-a205ff8695cc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:19.321127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd8c81-319f-41fd-9c43-1c4b92d10dbf admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:19.335921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 880/1727] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:19.344591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd8c81-319f-41fd-9c43-1c4b92d10dbf admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:19.359653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48652-3f50-4f93-97d6-02e982d1c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:19.360904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48652-3f50-4f93-97d6-02e982d1c611 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:19.361392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48652-3f50-4f93-97d6-02e982d1c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:19.362252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48652-3f50-4f93-97d6-02e982d1c611 admin admin] PATH_INFO: `/v3/projects/d425b5d6f37f4dd29233cbb4e555698d/users/384e9a6d68424232a4ec8fc8a73bbc48/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:19.393967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf48652-3f50-4f93-97d6-02e982d1c611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d425b5d6f37f4dd29233cbb4e555698d, user_id=384e9a6d68424232a4ec8fc8a73bbc48, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:19.406015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf48652-3f50-4f93-97d6-02e982d1c611 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:19.481568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6000aa-204e-4e8b-8a7d-ced0ab3f0629 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:19.481832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 848/1728] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:19 2022] PUT /identity/v3/projects/d425b5d6f37f4dd29233cbb4e555698d/users/384e9a6d68424232a4ec8fc8a73bbc48/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:19.481953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6000aa-204e-4e8b-8a7d-ced0ab3f0629 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:19.482158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6000aa-204e-4e8b-8a7d-ced0ab3f0629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:19.590240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ce6000aa-204e-4e8b-8a7d-ced0ab3f0629 None None] MFA Rules not processed for user `384e9a6d68424232a4ec8fc8a73bbc48`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:19.591550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ce6000aa-204e-4e8b-8a7d-ced0ab3f0629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:19.790939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48652-3f50-4f93-97d6-02e982d1c611 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:19.796871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 881/1729] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:19.866958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:19.957895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48652-3f50-4f93-97d6-02e982d1c611 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:19.984239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d293-d7d3-409b-a77b-74ffc828d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:19.985049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d293-d7d3-409b-a77b-74ffc828d0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:19.985418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d293-d7d3-409b-a77b-74ffc828d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:19.986182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d293-d7d3-409b-a77b-74ffc828d0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:19.986377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d293-d7d3-409b-a77b-74ffc828d0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:19.995219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6000aa-204e-4e8b-8a7d-ced0ab3f0629 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:19.997446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ce6000aa-204e-4e8b-8a7d-ced0ab3f0629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:19.998432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168d293-d7d3-409b-a77b-74ffc828d0c1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:20.045076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6000aa-204e-4e8b-8a7d-ced0ab3f0629 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:20.064180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:20.067649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:20.068478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:20.068931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] PATH_INFO: `/v3/projects/bbc6fdeb07134e8988d546fb69ec00ec` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:20.071679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc6fdeb07134e8988d546fb69ec00ec)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:20.075637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 849/1730] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:19 2022] POST /identity/v3/projects => generated 373 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:49:20.077285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d293-d7d3-409b-a77b-74ffc828d0c1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:20.080405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:20.201716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc6fdeb07134e8988d546fb69ec00ec', 'request_id': 'req-3c69b4db-a7a6-4bad-9ce8-717b55389db1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.212913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc6fdeb07134e8988d546fb69ec00ec', 'request_id': 'req-3c69b4db-a7a6-4bad-9ce8-717b55389db1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.226334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc6fdeb07134e8988d546fb69ec00ec', 'request_id': 'req-3c69b4db-a7a6-4bad-9ce8-717b55389db1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.252209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] The token cache is being invalidate because project bbc6fdeb07134e8988d546fb69ec00ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:20.252623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.262159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.265878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 882/1731] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:19 2022] DELETE /identity/v3/projects/bbc6fdeb07134e8988d546fb69ec00ec => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:20.269775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:20.275942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:20.285545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:20.295933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d293-d7d3-409b-a77b-74ffc828d0c1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:20.491897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69b4db-a7a6-4bad-9ce8-717b55389db1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:20.501273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642b3a0-7420-4a04-834a-4442a2c33c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:20.501868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642b3a0-7420-4a04-834a-4442a2c33c84 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:20.502158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642b3a0-7420-4a04-834a-4442a2c33c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:20.502437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642b3a0-7420-4a04-834a-4442a2c33c84 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:20.503087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642b3a0-7420-4a04-834a-4442a2c33c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:20.511338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642b3a0-7420-4a04-834a-4442a2c33c84 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:20.518411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:20.519161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:20.519423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:20.519858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] PATH_INFO: `/v3/users/5871e9f6abee4604a49842fa45e0ad05` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:20.525305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5871e9f6abee4604a49842fa45e0ad05)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:20.532725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:20.596497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 850/1732] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:20 2022] POST /identity/v3/users => generated 293 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:20.598198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e025c2-cc89-4a00-9857-6546bc274403 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:20.629973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e025c2-cc89-4a00-9857-6546bc274403 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:20.629973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e025c2-cc89-4a00-9857-6546bc274403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:20.723469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5871e9f6abee4604a49842fa45e0ad05'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.726039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5871e9f6abee4604a49842fa45e0ad05'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.748603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5871e9f6abee4604a49842fa45e0ad05'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.761512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5871e9f6abee4604a49842fa45e0ad05'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.795196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-43e025c2-cc89-4a00-9857-6546bc274403 None None] MFA Rules not processed for user `c1309821469549fe82a2c419ef4434d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:20.796859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-43e025c2-cc89-4a00-9857-6546bc274403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:20.829810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5871e9f6abee4604a49842fa45e0ad05'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:20.858659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 883/1733] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:20 2022] DELETE /identity/v3/users/5871e9f6abee4604a49842fa45e0ad05 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:20.860102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:20.861860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:20.933379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:21.012916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 851/1734] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:21.015416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e025c2-cc89-4a00-9857-6546bc274403 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:21.025668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-43e025c2-cc89-4a00-9857-6546bc274403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:21.046425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ee6d3-48ed-4b0e-98e3-2bd2318d62b2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:21.054435 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e025c2-cc89-4a00-9857-6546bc274403 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:21.061198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:21.062434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:21.062907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:21.063093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4cd4a-f16c-4517-8495-012b3b7aa85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:21.063593 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] PATH_INFO: `/v3/projects/bf2c97bbc52d43e4b0bace506b9b899f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:21.063739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4cd4a-f16c-4517-8495-012b3b7aa85d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:21.064012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4cd4a-f16c-4517-8495-012b3b7aa85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:21.064386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4cd4a-f16c-4517-8495-012b3b7aa85d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:21.064941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4cd4a-f16c-4517-8495-012b3b7aa85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:21.065767 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2c97bbc52d43e4b0bace506b9b899f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:21.067287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4cd4a-f16c-4517-8495-012b3b7aa85d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:21.085848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:21.108087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 884/1735] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:21.109418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c662-6189-4f0b-afee-bc40b10eb976 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:21.109739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c662-6189-4f0b-afee-bc40b10eb976 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:21.110020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c662-6189-4f0b-afee-bc40b10eb976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:21.167130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-80f0c662-6189-4f0b-afee-bc40b10eb976 None None] MFA Rules not processed for user `c1309821469549fe82a2c419ef4434d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:21.170194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-80f0c662-6189-4f0b-afee-bc40b10eb976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:21.204351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:21.212296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2c97bbc52d43e4b0bace506b9b899f', 'request_id': 'req-24336bbe-b877-4a86-9a8f-182910fdfba1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.220651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2c97bbc52d43e4b0bace506b9b899f', 'request_id': 'req-24336bbe-b877-4a86-9a8f-182910fdfba1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.232312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2c97bbc52d43e4b0bace506b9b899f', 'request_id': 'req-24336bbe-b877-4a86-9a8f-182910fdfba1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.290682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] The token cache is being invalidate because project bf2c97bbc52d43e4b0bace506b9b899f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:21.291028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.293941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.298051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 852/1736] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:21 2022] DELETE /identity/v3/projects/bf2c97bbc52d43e4b0bace506b9b899f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:21.300749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:21.304769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:21.356043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 885/1737] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:21.357229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c662-6189-4f0b-afee-bc40b10eb976 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:21.363097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-80f0c662-6189-4f0b-afee-bc40b10eb976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:21.430369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c662-6189-4f0b-afee-bc40b10eb976 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:21.530926 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336bbe-b877-4a86-9a8f-182910fdfba1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:21.548617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:21.549316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:21.549623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:21.549893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] PATH_INFO: `/v3/projects/ef35ea951bd0433a9af132bc72e0a857/users/dfb4a9206f2d4e8e85f9b61bf03702c2/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:21.601929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:21.602587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:21.602874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:21.603182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] PATH_INFO: `/v3/users/6c2c2852bde34e17b62e5bf01b4886ca` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:21.604427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2c2852bde34e17b62e5bf01b4886ca)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:21.606426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:21.616681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35ea951bd0433a9af132bc72e0a857, user_id=dfb4a9206f2d4e8e85f9b61bf03702c2, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:21.619627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:21.671747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 853/1738] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:21 2022] PUT /identity/v3/projects/ef35ea951bd0433a9af132bc72e0a857/users/dfb4a9206f2d4e8e85f9b61bf03702c2/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:21.673027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:21.674927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:21.733200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2c2852bde34e17b62e5bf01b4886ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.734001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2c2852bde34e17b62e5bf01b4886ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.752595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2c2852bde34e17b62e5bf01b4886ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.768017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2c2852bde34e17b62e5bf01b4886ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.817222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2c2852bde34e17b62e5bf01b4886ca'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:21.859918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 886/1739] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:21 2022] DELETE /identity/v3/users/6c2c2852bde34e17b62e5bf01b4886ca => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:21.860958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:21.868760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:21.872732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:21.970898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19335b-4ae1-4752-96f8-7918919f37f1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:22.016231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:22.067968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ec685-3457-4832-b270-542d6b249aad admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:22.098869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e7b5a-2584-4612-898a-1c242e3e2951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:22.099141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e7b5a-2584-4612-898a-1c242e3e2951 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:22.099468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e7b5a-2584-4612-898a-1c242e3e2951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:22.099749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e7b5a-2584-4612-898a-1c242e3e2951 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:22.108802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e7b5a-2584-4612-898a-1c242e3e2951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:22.111374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e7b5a-2584-4612-898a-1c242e3e2951 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:22.113357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dc021-3aa3-4777-899e-a503ef332a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:22.114183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc021-3aa3-4777-899e-a503ef332a5e service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:22.114471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc021-3aa3-4777-899e-a503ef332a5e service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:22.114750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc021-3aa3-4777-899e-a503ef332a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:22.117740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cb4dc021-3aa3-4777-899e-a503ef332a5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:22.135513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 887/1740] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:22.136899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b47358-de94-45c4-8b50-4ca38b46baf2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:22.137129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b47358-de94-45c4-8b50-4ca38b46baf2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:22.140350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b47358-de94-45c4-8b50-4ca38b46baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:22.227227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-93b47358-de94-45c4-8b50-4ca38b46baf2 None None] MFA Rules not processed for user `9c932f6c9f8b4e5d8eedfb5b597c0007`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:22.228533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-93b47358-de94-45c4-8b50-4ca38b46baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:22.232665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dc021-3aa3-4777-899e-a503ef332a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:22.234834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dc021-3aa3-4777-899e-a503ef332a5e service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:22.250113 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 854/1741] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:22.252487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457b99f-6134-4dcb-ba53-9f1aec8639fd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:22.252787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457b99f-6134-4dcb-ba53-9f1aec8639fd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:22.253068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457b99f-6134-4dcb-ba53-9f1aec8639fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:22.377073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0457b99f-6134-4dcb-ba53-9f1aec8639fd None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:22.380839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0457b99f-6134-4dcb-ba53-9f1aec8639fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:22.547372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 888/1742] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:22.550607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b47358-de94-45c4-8b50-4ca38b46baf2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:22.595113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b47358-de94-45c4-8b50-4ca38b46baf2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:22.596959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:22.610113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:22.612679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:22.612968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:22.613246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] PATH_INFO: `/v3/projects/ef35ea951bd0433a9af132bc72e0a857/users/dfb4a9206f2d4e8e85f9b61bf03702c2/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:22.618676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35ea951bd0433a9af132bc72e0a857, user_id=dfb4a9206f2d4e8e85f9b61bf03702c2, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:22.622213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 855/1743] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:49:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:22.625565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457b99f-6134-4dcb-ba53-9f1aec8639fd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:22.626326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:22.627763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0457b99f-6134-4dcb-ba53-9f1aec8639fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:22.657189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 889/1744] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:22 2022] PUT /identity/v3/projects/ef35ea951bd0433a9af132bc72e0a857/users/dfb4a9206f2d4e8e85f9b61bf03702c2/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:22.658501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:22.664357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457b99f-6134-4dcb-ba53-9f1aec8639fd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:22.667797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:22.816080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf9d1-c3ba-4faf-b061-7f4464c7a5bf admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:22.826382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:22.827499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:22.828396 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:22.829740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] PATH_INFO: `/v3/projects/a72dade5e5944b9aafcf082f121dec09` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:22.831923 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72dade5e5944b9aafcf082f121dec09)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:22.835765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:22.837496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390dcb1-d931-41e3-8f20-3492b0b3241d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:22.839871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390dcb1-d931-41e3-8f20-3492b0b3241d service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:22.840223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390dcb1-d931-41e3-8f20-3492b0b3241d service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:22.840593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390dcb1-d931-41e3-8f20-3492b0b3241d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:22.971822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72dade5e5944b9aafcf082f121dec09', 'request_id': 'req-3ba5c02e-93e4-4261-813b-7a3fa43091de'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:22.984632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72dade5e5944b9aafcf082f121dec09', 'request_id': 'req-3ba5c02e-93e4-4261-813b-7a3fa43091de'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:22.985481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:22.995547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390dcb1-d931-41e3-8f20-3492b0b3241d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:22.997460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390dcb1-d931-41e3-8f20-3492b0b3241d service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:23.008048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72dade5e5944b9aafcf082f121dec09', 'request_id': 'req-3ba5c02e-93e4-4261-813b-7a3fa43091de'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:23.019604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 890/1745] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:23.025873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35447a51-ca4b-49b9-bd4c-2ae2df5ab2ed None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:23.026237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35447a51-ca4b-49b9-bd4c-2ae2df5ab2ed None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:23.027382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35447a51-ca4b-49b9-bd4c-2ae2df5ab2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:23.028992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] The token cache is being invalidate because project a72dade5e5944b9aafcf082f121dec09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:23.029402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:23.032075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:23.035676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 856/1746] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:22 2022] DELETE /identity/v3/projects/a72dade5e5944b9aafcf082f121dec09 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:23.040206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:23.054533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:23.107444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-35447a51-ca4b-49b9-bd4c-2ae2df5ab2ed None None] MFA Rules not processed for user `dfb4a9206f2d4e8e85f9b61bf03702c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:23.108708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-35447a51-ca4b-49b9-bd4c-2ae2df5ab2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:23.313353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 891/1747] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:23.313353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353341-ab7d-4e68-a026-f35416754ad7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:23.313353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353341-ab7d-4e68-a026-f35416754ad7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:23.313353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353341-ab7d-4e68-a026-f35416754ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:23.330712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5c02e-93e4-4261-813b-7a3fa43091de admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:23.338524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:23.339830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:23.340041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:23.340325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:23.343203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:23.352614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:23.358479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-11353341-ab7d-4e68-a026-f35416754ad7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:23.358479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-11353341-ab7d-4e68-a026-f35416754ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:23.507361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:23.509216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:23.526308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 857/1748] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:49:23.527484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:23.529214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:23.586605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 892/1749] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:23.587483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11353341-ab7d-4e68-a026-f35416754ad7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:23.602535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-11353341-ab7d-4e68-a026-f35416754ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:23.755619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd163d-fa77-4d44-8b8f-fb449ca248fc service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:23.779327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:23.780378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:23.780870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:23.781392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] PATH_INFO: `/v3/projects/00b8e9a7b7154b36bfc4699f4f52f632` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:23.784485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b8e9a7b7154b36bfc4699f4f52f632)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:23.787311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:23.874328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11353341-ab7d-4e68-a026-f35416754ad7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:23.887011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbd161-23fa-43b9-9504-4119ecf82438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:23.887654 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd161-23fa-43b9-9504-4119ecf82438 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:23.888016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd161-23fa-43b9-9504-4119ecf82438 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:23.888201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbd161-23fa-43b9-9504-4119ecf82438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:23.919892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbd161-23fa-43b9-9504-4119ecf82438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:23.921378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbd161-23fa-43b9-9504-4119ecf82438 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:23.953717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 893/1750] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:23.955130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590c324-dfa5-463e-98fb-6999db5d44c9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:23.955425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590c324-dfa5-463e-98fb-6999db5d44c9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:23.955725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590c324-dfa5-463e-98fb-6999db5d44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:24.013319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b8e9a7b7154b36bfc4699f4f52f632', 'request_id': 'req-991d09b2-398e-4fbc-ab0b-d7315650bcc2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.025907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b590c324-dfa5-463e-98fb-6999db5d44c9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:24.032899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b8e9a7b7154b36bfc4699f4f52f632', 'request_id': 'req-991d09b2-398e-4fbc-ab0b-d7315650bcc2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.035555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b590c324-dfa5-463e-98fb-6999db5d44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:24.054903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b8e9a7b7154b36bfc4699f4f52f632', 'request_id': 'req-991d09b2-398e-4fbc-ab0b-d7315650bcc2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.091046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] The token cache is being invalidate because project 00b8e9a7b7154b36bfc4699f4f52f632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:24.091437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.098159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-991d09b2-398e-4fbc-ab0b-d7315650bcc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.100615 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 858/1751] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:23 2022] DELETE /identity/v3/projects/00b8e9a7b7154b36bfc4699f4f52f632 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:24.107658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312adc2-832d-4210-af28-a9792b2ae753 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:24.108013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312adc2-832d-4210-af28-a9792b2ae753 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:24.108371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312adc2-832d-4210-af28-a9792b2ae753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:24.148890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:24.153865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6312adc2-832d-4210-af28-a9792b2ae753 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:24.155236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6312adc2-832d-4210-af28-a9792b2ae753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:24.239426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:24.310939 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 894/1752] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:24.311725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590c324-dfa5-463e-98fb-6999db5d44c9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:24.319219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b590c324-dfa5-463e-98fb-6999db5d44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:24.343165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 859/1753] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:24.343165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312adc2-832d-4210-af28-a9792b2ae753 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:24.370688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312adc2-832d-4210-af28-a9792b2ae753 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:24.380575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:24.381219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:24.383457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:24.383742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:24.387085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:24.387411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:24.390621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:24.441869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 860/1754] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:24.447182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:24.460872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:24.499650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55b4c2-255f-4223-ba6c-7f0783764327 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:24.521749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590c324-dfa5-463e-98fb-6999db5d44c9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:24.525644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:24.526387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:24.526677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:24.526956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] PATH_INFO: `/v3/users/56887264e355449d9dee481cf2f9f649` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:24.533893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56887264e355449d9dee481cf2f9f649)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:24.534949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136af02-5960-4f95-8bf4-aebc5cbb5d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:24.535792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136af02-5960-4f95-8bf4-aebc5cbb5d6a service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:24.536085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136af02-5960-4f95-8bf4-aebc5cbb5d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:24.536369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136af02-5960-4f95-8bf4-aebc5cbb5d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:24.538406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d136af02-5960-4f95-8bf4-aebc5cbb5d6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:24.545206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:24.684650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56887264e355449d9dee481cf2f9f649'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.686517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56887264e355449d9dee481cf2f9f649'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.703976 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56887264e355449d9dee481cf2f9f649'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.704948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56887264e355449d9dee481cf2f9f649'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.736826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56887264e355449d9dee481cf2f9f649'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:24.745864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136af02-5960-4f95-8bf4-aebc5cbb5d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:24.752299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136af02-5960-4f95-8bf4-aebc5cbb5d6a service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:24.786956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 895/1755] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:24.788859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9af1-ba9e-43e8-8386-785e05745298 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:24.791180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9af1-ba9e-43e8-8386-785e05745298 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:24.793560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e9af1-ba9e-43e8-8386-785e05745298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:24.833088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 861/1756] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:24 2022] DELETE /identity/v3/users/56887264e355449d9dee481cf2f9f649 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:24.840844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:24.849474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:24.871557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-161e9af1-ba9e-43e8-8386-785e05745298 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:24.890137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-161e9af1-ba9e-43e8-8386-785e05745298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:25.083138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 896/1757] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:25.085137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740aef-9952-4e11-b1ea-d73e37f7f99c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:25.085535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740aef-9952-4e11-b1ea-d73e37f7f99c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:25.086650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740aef-9952-4e11-b1ea-d73e37f7f99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:25.122486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-23740aef-9952-4e11-b1ea-d73e37f7f99c None None] MFA Rules not processed for user `c1309821469549fe82a2c419ef4434d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:25.124806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-23740aef-9952-4e11-b1ea-d73e37f7f99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:25.172075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:25.219038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bd8d2-9c52-4037-b3ea-b603131b95b0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:25.233264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845613f-694d-46b4-9f2f-3d71e993a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:25.233971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845613f-694d-46b4-9f2f-3d71e993a4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:25.234330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845613f-694d-46b4-9f2f-3d71e993a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:25.234686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845613f-694d-46b4-9f2f-3d71e993a4f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:25.235425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845613f-694d-46b4-9f2f-3d71e993a4f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:25.238270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845613f-694d-46b4-9f2f-3d71e993a4f2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:25.310032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 897/1758] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:25.311750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22e624-56b6-4105-935b-044be79157ea None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:25.312218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22e624-56b6-4105-935b-044be79157ea None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:25.312668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22e624-56b6-4105-935b-044be79157ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:25.357466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2b22e624-56b6-4105-935b-044be79157ea None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:25.362195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2b22e624-56b6-4105-935b-044be79157ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:25.363570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 862/1759] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:24 2022] POST /identity/v3/projects => generated 375 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:25.378346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845613f-694d-46b4-9f2f-3d71e993a4f2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:25.449717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:25.574777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845613f-694d-46b4-9f2f-3d71e993a4f2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:25.586558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:25.588820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:25.589104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:25.589385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:25.591985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:25.592290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:25.597437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 898/1760] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:25.598638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22e624-56b6-4105-935b-044be79157ea None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:25.599599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:25.637836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22e624-56b6-4105-935b-044be79157ea None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:25.648434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 863/1761] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:25.654032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:25.656711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7aaa0-cec3-4900-b64f-2cb90c811c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:25.660109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7aaa0-cec3-4900-b64f-2cb90c811c2d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:25.660427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:25.660820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7aaa0-cec3-4900-b64f-2cb90c811c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:25.661368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7aaa0-cec3-4900-b64f-2cb90c811c2d admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:25.663757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7aaa0-cec3-4900-b64f-2cb90c811c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:25.667578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7aaa0-cec3-4900-b64f-2cb90c811c2d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:25.740663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 899/1762] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:25 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:25.745170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7aaa0-cec3-4900-b64f-2cb90c811c2d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:25.789800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7aaa0-cec3-4900-b64f-2cb90c811c2d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:25.814122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac595ace-74f6-4d29-affa-f1c1af886933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:25.815049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac595ace-74f6-4d29-affa-f1c1af886933 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:25.815479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac595ace-74f6-4d29-affa-f1c1af886933 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:25.816108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac595ace-74f6-4d29-affa-f1c1af886933 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:25.816893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac595ace-74f6-4d29-affa-f1c1af886933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:25.819847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac595ace-74f6-4d29-affa-f1c1af886933 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:25.857741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ea28e-a23b-408e-8ec9-6bcf81d1930d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:25.863730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588e8ad-8cc2-43fa-90ab-eb566492669f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:25.865371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588e8ad-8cc2-43fa-90ab-eb566492669f service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:25.865869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588e8ad-8cc2-43fa-90ab-eb566492669f service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:25.866380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588e8ad-8cc2-43fa-90ab-eb566492669f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:25.891522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 900/1763] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:25 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:25.893153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684029c-7218-4af9-925c-381542936527 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:25.893851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684029c-7218-4af9-925c-381542936527 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:25.894536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684029c-7218-4af9-925c-381542936527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:25.913550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588e8ad-8cc2-43fa-90ab-eb566492669f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:25.923550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588e8ad-8cc2-43fa-90ab-eb566492669f service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:25.962626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0684029c-7218-4af9-925c-381542936527 None None] MFA Rules not processed for user `66f98af5c7194ce58dde8258e2ecf945`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:25.964523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0684029c-7218-4af9-925c-381542936527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:25.976046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 864/1764] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:25.983371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588e8ad-8cc2-43fa-90ab-eb566492669f service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:26.058838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588e8ad-8cc2-43fa-90ab-eb566492669f service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:26.227252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 901/1765] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:26.228416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684029c-7218-4af9-925c-381542936527 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:26.307112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:26.443070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:26.446230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:26.446519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:26.446800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:26.447478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:26.464068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:26.505298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 865/1766] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:26.506531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:26.520700 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:26.571271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684029c-7218-4af9-925c-381542936527 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:26.586302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d09d73-0a78-4815-bdb3-7d4bf120494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:26.586938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d09d73-0a78-4815-bdb3-7d4bf120494a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:26.587219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d09d73-0a78-4815-bdb3-7d4bf120494a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:26.587497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d09d73-0a78-4815-bdb3-7d4bf120494a admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:26.588141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d09d73-0a78-4815-bdb3-7d4bf120494a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:26.590137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d09d73-0a78-4815-bdb3-7d4bf120494a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:26.669156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 902/1767] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:26 2022] POST /identity/v3/users => generated 291 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:26.670068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d09d73-0a78-4815-bdb3-7d4bf120494a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:26.710269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d09d73-0a78-4815-bdb3-7d4bf120494a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:26.718422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:26.722643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ec795-eb78-4bd3-878b-a0bcbb629338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:26.724702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ec795-eb78-4bd3-878b-a0bcbb629338 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:26.724702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ec795-eb78-4bd3-878b-a0bcbb629338 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:26.724986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ec795-eb78-4bd3-878b-a0bcbb629338 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:26.725679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ec795-eb78-4bd3-878b-a0bcbb629338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:26.727925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ec795-eb78-4bd3-878b-a0bcbb629338 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:26.757252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 903/1768] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:26.760216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bafeb-ebc1-4437-9131-eee2350fb7d2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:26.760505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bafeb-ebc1-4437-9131-eee2350fb7d2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:26.763333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bafeb-ebc1-4437-9131-eee2350fb7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:26.767245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63826-0ea1-4850-8e0b-5193b157fe7d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:26.782393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bd512-ab6c-4101-925f-931a1622904b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:26.784998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bd512-ab6c-4101-925f-931a1622904b service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:26.785337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bd512-ab6c-4101-925f-931a1622904b service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:26.789299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593bd512-ab6c-4101-925f-931a1622904b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:26.828241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bd512-ab6c-4101-925f-931a1622904b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:26.831387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593bd512-ab6c-4101-925f-931a1622904b service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:26.834951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a52bafeb-ebc1-4437-9131-eee2350fb7d2 None None] MFA Rules not processed for user `3e1d9844633a4afaacbb1867b8bbe582`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:26.841978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a52bafeb-ebc1-4437-9131-eee2350fb7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:26.877349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 866/1769] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:26.878328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bd512-ab6c-4101-925f-931a1622904b service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:26.921803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593bd512-ab6c-4101-925f-931a1622904b service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:26.945988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf6739-b2f4-430b-a4b3-2fa6a091bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:26.950255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6739-b2f4-430b-a4b3-2fa6a091bbaf admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:26.950508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6739-b2f4-430b-a4b3-2fa6a091bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:26.950794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf6739-b2f4-430b-a4b3-2fa6a091bbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:26.951742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf6739-b2f4-430b-a4b3-2fa6a091bbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:26.958566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf6739-b2f4-430b-a4b3-2fa6a091bbaf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:27.004639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 867/1770] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:27.007577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46191-1010-421b-a5ab-2aedb85db10e None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:27.011885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46191-1010-421b-a5ab-2aedb85db10e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:27.011885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd46191-1010-421b-a5ab-2aedb85db10e None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:27.017558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 868/1771] 10.222.0.30 () {54 vars in 912 bytes} [Tue Oct 4 12:49:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:27.018732 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd46191-1010-421b-a5ab-2aedb85db10e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:27.075759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 904/1772] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Oct 4 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:27.079562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bafeb-ebc1-4437-9131-eee2350fb7d2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:27.080287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd46191-1010-421b-a5ab-2aedb85db10e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:27.102769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:27.104971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:27.117356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:27.118996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] PATH_INFO: `/v3/projects/5e3e38c9e35a4d1582a6cf9761fd0a82/users/62903eb243d945bcbde3486f4ac3da9a/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:27.135847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bafeb-ebc1-4437-9131-eee2350fb7d2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:27.165449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac3a68-13bf-44c2-91fc-fc846bb71595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:27.167011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3a68-13bf-44c2-91fc-fc846bb71595 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:27.167194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3a68-13bf-44c2-91fc-fc846bb71595 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:27.171231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3a68-13bf-44c2-91fc-fc846bb71595 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:27.174422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac3a68-13bf-44c2-91fc-fc846bb71595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:27.183959 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac3a68-13bf-44c2-91fc-fc846bb71595 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:27.194943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3e38c9e35a4d1582a6cf9761fd0a82, user_id=62903eb243d945bcbde3486f4ac3da9a, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:27.214081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:27.233273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 905/1773] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:27.235601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74fd0c-35ea-4f37-bbaa-ebe9b0e151ac None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:27.236115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74fd0c-35ea-4f37-bbaa-ebe9b0e151ac None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:27.236682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74fd0c-35ea-4f37-bbaa-ebe9b0e151ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:27.262692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 869/1774] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:27 2022] PUT /identity/v3/projects/5e3e38c9e35a4d1582a6cf9761fd0a82/users/62903eb243d945bcbde3486f4ac3da9a/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:27.269407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:27.275141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:27.346507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ed74fd0c-35ea-4f37-bbaa-ebe9b0e151ac None None] MFA Rules not processed for user `3e1d9844633a4afaacbb1867b8bbe582`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:27.352808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ed74fd0c-35ea-4f37-bbaa-ebe9b0e151ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:27.617101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b4fa6-d3f0-4af5-afc4-aee1376d1b13 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:27.638702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62580096-d3fc-4885-bf2f-2bfd7cb95ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:27.639585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580096-d3fc-4885-bf2f-2bfd7cb95ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:27.640188 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580096-d3fc-4885-bf2f-2bfd7cb95ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:27.640626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580096-d3fc-4885-bf2f-2bfd7cb95ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:27.641820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 906/1775] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:49:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:27.642879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74fd0c-35ea-4f37-bbaa-ebe9b0e151ac None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:27.654207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62580096-d3fc-4885-bf2f-2bfd7cb95ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:27.656312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62580096-d3fc-4885-bf2f-2bfd7cb95ff6 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:27.677878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 870/1776] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:27.679484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcfbb7-9ecc-438d-a5fc-eca71e5aa7ea None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:27.679786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcfbb7-9ecc-438d-a5fc-eca71e5aa7ea None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:27.680117 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcfbb7-9ecc-438d-a5fc-eca71e5aa7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:27.752377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-76bcfbb7-9ecc-438d-a5fc-eca71e5aa7ea None None] MFA Rules not processed for user `62903eb243d945bcbde3486f4ac3da9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:27.753696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-76bcfbb7-9ecc-438d-a5fc-eca71e5aa7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:27.775632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:27.864168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74fd0c-35ea-4f37-bbaa-ebe9b0e151ac None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:27.877586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959297f-9e65-4ca4-87c4-8834341e13ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:27.882235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959297f-9e65-4ca4-87c4-8834341e13ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:27.882653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959297f-9e65-4ca4-87c4-8834341e13ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:27.883582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959297f-9e65-4ca4-87c4-8834341e13ae admin admin] PATH_INFO: `/v3/projects/6ef76523ed9742898256695c162bc462/users/e09d18c6d7de48018485dd0804342ed5/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:27.916398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 871/1777] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:27.917306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcfbb7-9ecc-438d-a5fc-eca71e5aa7ea None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:27.918822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-76bcfbb7-9ecc-438d-a5fc-eca71e5aa7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:27.949637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcfbb7-9ecc-438d-a5fc-eca71e5aa7ea None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:27.959911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:27.960510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:27.960798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:27.961076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] PATH_INFO: `/v3/projects/88a664ae803041a3a920a94be6463544` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:27.962651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a664ae803041a3a920a94be6463544)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:27.966193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959297f-9e65-4ca4-87c4-8834341e13ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef76523ed9742898256695c162bc462, user_id=e09d18c6d7de48018485dd0804342ed5, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:27.969784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:27.977697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959297f-9e65-4ca4-87c4-8834341e13ae admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:28.044976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 907/1778] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:27 2022] PUT /identity/v3/projects/6ef76523ed9742898256695c162bc462/users/e09d18c6d7de48018485dd0804342ed5/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:28.047674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959297f-9e65-4ca4-87c4-8834341e13ae admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:28.074850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:28.098871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a664ae803041a3a920a94be6463544', 'request_id': 'req-72538eb6-bd9d-4170-b195-e1799c56571b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:28.118675 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a664ae803041a3a920a94be6463544', 'request_id': 'req-72538eb6-bd9d-4170-b195-e1799c56571b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:28.147542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a664ae803041a3a920a94be6463544', 'request_id': 'req-72538eb6-bd9d-4170-b195-e1799c56571b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:28.193213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] The token cache is being invalidate because project 88a664ae803041a3a920a94be6463544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:28.193578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:28.197674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:28.206261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 872/1779] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:27 2022] DELETE /identity/v3/projects/88a664ae803041a3a920a94be6463544 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:28.210111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:28.219707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:28.315820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959297f-9e65-4ca4-87c4-8834341e13ae admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:28.458220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72538eb6-bd9d-4170-b195-e1799c56571b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:28.506839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973cede-da00-4b8b-9c5b-5579a21629eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:28.507554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973cede-da00-4b8b-9c5b-5579a21629eb admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:28.507842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973cede-da00-4b8b-9c5b-5579a21629eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:28.508124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973cede-da00-4b8b-9c5b-5579a21629eb admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:28.517379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973cede-da00-4b8b-9c5b-5579a21629eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:28.522722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973cede-da00-4b8b-9c5b-5579a21629eb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:28.527973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:28.577007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:28.578172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:28.581712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:28.585256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 873/1780] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:28 2022] POST /identity/v3/projects => generated 377 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:28.588885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba8dfb-6e32-404f-832a-fe6efa4d447e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:28.589143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba8dfb-6e32-404f-832a-fe6efa4d447e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:28.589423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba8dfb-6e32-404f-832a-fe6efa4d447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:28.603926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:28.668181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-28ba8dfb-6e32-404f-832a-fe6efa4d447e None None] MFA Rules not processed for user `e09d18c6d7de48018485dd0804342ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:28.669945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-28ba8dfb-6e32-404f-832a-fe6efa4d447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:28.679780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:28.683461 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:28.710242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 908/1781] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:28.713190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:28.718526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:28.801946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191a38-1ad3-4e31-8b90-b1a1792cd1ed service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:28.953237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 874/1782] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:28.961841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba8dfb-6e32-404f-832a-fe6efa4d447e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:29.009087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:29.010040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:29.010322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:29.010607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] PATH_INFO: `/v3/users/19ba7e87e92545d282e1aec787459dee` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:29.012351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ba7e87e92545d282e1aec787459dee)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:29.014826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:29.050283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:29.124328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ba7e87e92545d282e1aec787459dee'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:29.126125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ba7e87e92545d282e1aec787459dee'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:29.130740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:29.147222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ba7e87e92545d282e1aec787459dee'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:29.148605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ba7e87e92545d282e1aec787459dee'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:29.199098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba8dfb-6e32-404f-832a-fe6efa4d447e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:29.204296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ba7e87e92545d282e1aec787459dee'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:29.205292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:29.206245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:29.206614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:29.206896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:29.207604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:29.210866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:29.249927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 909/1783] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:28 2022] DELETE /identity/v3/users/19ba7e87e92545d282e1aec787459dee => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:29.251252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:29.270539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:29.279037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 875/1784] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:28 2022] POST /identity/v3/users => generated 295 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:29.281474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:29.295411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:29.319970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc15bb-ea59-484f-88a7-a93989e46b97 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:29.479947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2bb03-dd63-4c6e-931c-13c021e15a22 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:29.500090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ca84c-251e-4dfe-9f88-71b5ca85c564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:29.500919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ca84c-251e-4dfe-9f88-71b5ca85c564 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:29.501210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ca84c-251e-4dfe-9f88-71b5ca85c564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:29.501713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ca84c-251e-4dfe-9f88-71b5ca85c564 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:29.502342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ca84c-251e-4dfe-9f88-71b5ca85c564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:29.504854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ca84c-251e-4dfe-9f88-71b5ca85c564 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:29.567695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 910/1785] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:29 2022] POST /identity/v3/projects => generated 379 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:29.571907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ca84c-251e-4dfe-9f88-71b5ca85c564 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:29.644614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2cd77-a526-4356-87da-4f00ee22015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:29.645520 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2cd77-a526-4356-87da-4f00ee22015f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:29.645827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2cd77-a526-4356-87da-4f00ee22015f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:29.646629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2cd77-a526-4356-87da-4f00ee22015f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:29.647291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2cd77-a526-4356-87da-4f00ee22015f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:29.648926 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2cd77-a526-4356-87da-4f00ee22015f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:29.687127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 876/1786] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:29.692271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2cd77-a526-4356-87da-4f00ee22015f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:29.730461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2cd77-a526-4356-87da-4f00ee22015f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:29.739827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ca84c-251e-4dfe-9f88-71b5ca85c564 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:29.795826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929f44f-864d-4025-a475-d3ff8d2b1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:29.796627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315f532-2daf-4e22-a67b-2649270d6afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:29.797472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929f44f-864d-4025-a475-d3ff8d2b1c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:29.798228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929f44f-864d-4025-a475-d3ff8d2b1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:29.800015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f532-2daf-4e22-a67b-2649270d6afa admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:29.800380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929f44f-864d-4025-a475-d3ff8d2b1c7f admin admin] PATH_INFO: `/v3/projects/83f6cb287830466cb9093ff92d3dd1bd/users/61b86e4b80b04df58de44c5099f933c1/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:29.800769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f532-2daf-4e22-a67b-2649270d6afa admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:29.802973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f532-2daf-4e22-a67b-2649270d6afa admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:29.806680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315f532-2daf-4e22-a67b-2649270d6afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:29.817067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315f532-2daf-4e22-a67b-2649270d6afa admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:29.872282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929f44f-864d-4025-a475-d3ff8d2b1c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f6cb287830466cb9093ff92d3dd1bd, user_id=61b86e4b80b04df58de44c5099f933c1, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:29.875628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929f44f-864d-4025-a475-d3ff8d2b1c7f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:29.893744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 911/1787] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:29 2022] POST /identity/v3/users => generated 296 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:49:29.897774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315f532-2daf-4e22-a67b-2649270d6afa admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:29.921478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 877/1788] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:29 2022] PUT /identity/v3/projects/83f6cb287830466cb9093ff92d3dd1bd/users/61b86e4b80b04df58de44c5099f933c1/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:29.925849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929f44f-864d-4025-a475-d3ff8d2b1c7f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:29.933220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315f532-2daf-4e22-a67b-2649270d6afa admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:29.973336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:30.117807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66ed0b-e03b-4c59-8c5d-7fa18ababeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:30.119098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929f44f-864d-4025-a475-d3ff8d2b1c7f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:30.119742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66ed0b-e03b-4c59-8c5d-7fa18ababeae admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:30.120119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66ed0b-e03b-4c59-8c5d-7fa18ababeae admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:30.120808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66ed0b-e03b-4c59-8c5d-7fa18ababeae admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:30.122093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66ed0b-e03b-4c59-8c5d-7fa18ababeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:30.127393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66ed0b-e03b-4c59-8c5d-7fa18ababeae admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:30.132161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17906b3-bb52-48a7-a181-96d3afbac70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:30.134173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17906b3-bb52-48a7-a181-96d3afbac70f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:30.136731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17906b3-bb52-48a7-a181-96d3afbac70f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:30.136731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17906b3-bb52-48a7-a181-96d3afbac70f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:30.136978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17906b3-bb52-48a7-a181-96d3afbac70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:30.146504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17906b3-bb52-48a7-a181-96d3afbac70f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:30.161964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 912/1789] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:30.164282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66ed0b-e03b-4c59-8c5d-7fa18ababeae admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:30.178600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 878/1790] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:30.181792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17906b3-bb52-48a7-a181-96d3afbac70f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:30.198508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66ed0b-e03b-4c59-8c5d-7fa18ababeae admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:30.207503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f620-e59d-4f45-b0a3-2d6fc1c7e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:30.209252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f620-e59d-4f45-b0a3-2d6fc1c7e53c admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:30.210587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17906b3-bb52-48a7-a181-96d3afbac70f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:30.210975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f620-e59d-4f45-b0a3-2d6fc1c7e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:30.211434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414f620-e59d-4f45-b0a3-2d6fc1c7e53c admin admin] PATH_INFO: `/v3/projects/be226858358948a9871897ec63156a14/users/a351a6bd9e864ad9b5e719f4492ce0a5/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:30.224340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9352a-f009-4fc6-8e09-f1c49f5db048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:30.231543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9352a-f009-4fc6-8e09-f1c49f5db048 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:30.231971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9352a-f009-4fc6-8e09-f1c49f5db048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:30.232895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9352a-f009-4fc6-8e09-f1c49f5db048 admin admin] PATH_INFO: `/v3/projects/83f6cb287830466cb9093ff92d3dd1bd/users/61b86e4b80b04df58de44c5099f933c1/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:30.238212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9352a-f009-4fc6-8e09-f1c49f5db048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f6cb287830466cb9093ff92d3dd1bd, user_id=61b86e4b80b04df58de44c5099f933c1, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:30.248573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9352a-f009-4fc6-8e09-f1c49f5db048 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:30.256272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f620-e59d-4f45-b0a3-2d6fc1c7e53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be226858358948a9871897ec63156a14, user_id=a351a6bd9e864ad9b5e719f4492ce0a5, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:30.262908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414f620-e59d-4f45-b0a3-2d6fc1c7e53c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:30.283735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 879/1791] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:30 2022] PUT /identity/v3/projects/83f6cb287830466cb9093ff92d3dd1bd/users/61b86e4b80b04df58de44c5099f933c1/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:30.304619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83951-9382-490e-8930-51cdcaa7f95d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:30.304619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83951-9382-490e-8930-51cdcaa7f95d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:30.304619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83951-9382-490e-8930-51cdcaa7f95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:30.337878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 913/1792] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:30 2022] PUT /identity/v3/projects/be226858358948a9871897ec63156a14/users/a351a6bd9e864ad9b5e719f4492ce0a5/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:30.341938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f620-e59d-4f45-b0a3-2d6fc1c7e53c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:30.397312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f6b83951-9382-490e-8930-51cdcaa7f95d None None] MFA Rules not processed for user `61b86e4b80b04df58de44c5099f933c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:30.401869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f6b83951-9382-490e-8930-51cdcaa7f95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:30.461483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:30.639912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414f620-e59d-4f45-b0a3-2d6fc1c7e53c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:30.659154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba304cdb-8ced-4f8d-8d87-b8f57dded607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:30.660173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304cdb-8ced-4f8d-8d87-b8f57dded607 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:30.663368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304cdb-8ced-4f8d-8d87-b8f57dded607 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:30.664878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba304cdb-8ced-4f8d-8d87-b8f57dded607 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:30.667261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba304cdb-8ced-4f8d-8d87-b8f57dded607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:30.671635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba304cdb-8ced-4f8d-8d87-b8f57dded607 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:30.702291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 914/1793] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:49:30.707098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba304cdb-8ced-4f8d-8d87-b8f57dded607 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:30.729942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba304cdb-8ced-4f8d-8d87-b8f57dded607 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:30.747723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a15e7-9258-45df-bfca-bbde02bf12a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:30.757458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a15e7-9258-45df-bfca-bbde02bf12a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:30.758297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a15e7-9258-45df-bfca-bbde02bf12a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:30.758833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a15e7-9258-45df-bfca-bbde02bf12a4 admin admin] PATH_INFO: `/v3/projects/be226858358948a9871897ec63156a14/users/a351a6bd9e864ad9b5e719f4492ce0a5/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:30.762775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a15e7-9258-45df-bfca-bbde02bf12a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be226858358948a9871897ec63156a14, user_id=a351a6bd9e864ad9b5e719f4492ce0a5, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:30.766743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 880/1794] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:30.769801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a15e7-9258-45df-bfca-bbde02bf12a4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:30.773918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b83951-9382-490e-8930-51cdcaa7f95d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:30.781972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f6b83951-9382-490e-8930-51cdcaa7f95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:30.816797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 915/1795] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:30 2022] PUT /identity/v3/projects/be226858358948a9871897ec63156a14/users/a351a6bd9e864ad9b5e719f4492ce0a5/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:30.821235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348c777-ece0-4920-9010-b2a7bbc4256e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:30.821553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348c777-ece0-4920-9010-b2a7bbc4256e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:30.821948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348c777-ece0-4920-9010-b2a7bbc4256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:30.924892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2348c777-ece0-4920-9010-b2a7bbc4256e None None] MFA Rules not processed for user `a351a6bd9e864ad9b5e719f4492ce0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:30.926758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2348c777-ece0-4920-9010-b2a7bbc4256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:31.068875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b83951-9382-490e-8930-51cdcaa7f95d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:31.152374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d76e51-1267-4fee-9e78-11fb4b428737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:31.153156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d76e51-1267-4fee-9e78-11fb4b428737 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:31.153411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d76e51-1267-4fee-9e78-11fb4b428737 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:31.154049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d76e51-1267-4fee-9e78-11fb4b428737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:31.155777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-46d76e51-1267-4fee-9e78-11fb4b428737 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:31.161357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:31.189783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 916/1796] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:31.246119 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d76e51-1267-4fee-9e78-11fb4b428737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:31.247779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d76e51-1267-4fee-9e78-11fb4b428737 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:31.260035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 881/1797] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:31.957088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348c777-ece0-4920-9010-b2a7bbc4256e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:31.960968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2348c777-ece0-4920-9010-b2a7bbc4256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:31.985459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348c777-ece0-4920-9010-b2a7bbc4256e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:32.012025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:32.017122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:32.018406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:32.019544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:32.054231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:32.056095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:32.085777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 917/1798] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:33.056415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f270-41d9-44fa-80dd-678d5d391d06 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:33.056911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f270-41d9-44fa-80dd-678d5d391d06 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:33.057201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f270-41d9-44fa-80dd-678d5d391d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:33.142158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c602f270-41d9-44fa-80dd-678d5d391d06 None None] MFA Rules not processed for user `9c932f6c9f8b4e5d8eedfb5b597c0007`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:33.150717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c602f270-41d9-44fa-80dd-678d5d391d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:33.197307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:33.377312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:33.381586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:33.456561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 882/1799] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:33.460881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602f270-41d9-44fa-80dd-678d5d391d06 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:33.540477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602f270-41d9-44fa-80dd-678d5d391d06 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:33.564281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351a6bd9e864ad9b5e719f4492ce0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be226858358948a9871897ec63156a14', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:33.568449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:33.568719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:33.569004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:33.571128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:33.571440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:33.575438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:33.666869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 883/1800] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:33.670600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:33.758977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaee187-4b26-44dd-b93c-d1f66f0082d6 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:33.798322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0223f65-40c1-46a1-92ae-b8fa95ba41e4 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351a6bd9e864ad9b5e719f4492ce0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be226858358948a9871897ec63156a14', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:33.799039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0223f65-40c1-46a1-92ae-b8fa95ba41e4 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:33.799424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0223f65-40c1-46a1-92ae-b8fa95ba41e4 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:33.799766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0223f65-40c1-46a1-92ae-b8fa95ba41e4 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:33.800457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0223f65-40c1-46a1-92ae-b8fa95ba41e4 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:33.822510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0223f65-40c1-46a1-92ae-b8fa95ba41e4 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:33.824943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76242c-c4a6-4082-b7c1-18ffe3136b7d service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:33.873701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:33.876605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:33.877124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:33.880351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] PATH_INFO: `/v3/projects/105620f6b6b546c4b447489ca25bada8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:33.888844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=105620f6b6b546c4b447489ca25bada8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:33.903012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:33.942549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 884/1801] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:33 2022] POST /identity/v3/projects => generated 355 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:33.944704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0223f65-40c1-46a1-92ae-b8fa95ba41e4 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:34.088446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105620f6b6b546c4b447489ca25bada8', 'request_id': 'req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.107315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105620f6b6b546c4b447489ca25bada8', 'request_id': 'req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.122087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105620f6b6b546c4b447489ca25bada8', 'request_id': 'req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.170757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] The token cache is being invalidate because project 105620f6b6b546c4b447489ca25bada8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:34.171604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.173453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dbc30423-ca7f-4fb8-91a6-e65549eaa5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.176436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 918/1802] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:33 2022] DELETE /identity/v3/projects/105620f6b6b546c4b447489ca25bada8 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:34.179310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccffa17-b928-4df3-af79-d5ee6c336a10 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:34.179892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccffa17-b928-4df3-af79-d5ee6c336a10 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:34.180458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccffa17-b928-4df3-af79-d5ee6c336a10 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:34.183378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 919/1803] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:49:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:34.185373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cd5b7-f9fc-4fcd-920a-3fda67ab04dc None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:34.185986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cd5b7-f9fc-4fcd-920a-3fda67ab04dc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:34.186562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cd5b7-f9fc-4fcd-920a-3fda67ab04dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:34.190237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0223f65-40c1-46a1-92ae-b8fa95ba41e4 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:34.260246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-dd0cd5b7-f9fc-4fcd-920a-3fda67ab04dc None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:34.265261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dd0cd5b7-f9fc-4fcd-920a-3fda67ab04dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:34.422586 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde8c37-af7c-4055-8fb8-7ddce95f0a34 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351a6bd9e864ad9b5e719f4492ce0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be226858358948a9871897ec63156a14', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:34.423286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8c37-af7c-4055-8fb8-7ddce95f0a34 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:34.423572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8c37-af7c-4055-8fb8-7ddce95f0a34 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:34.423851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8c37-af7c-4055-8fb8-7ddce95f0a34 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:34.425766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8c37-af7c-4055-8fb8-7ddce95f0a34 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:34.426250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8c37-af7c-4055-8fb8-7ddce95f0a34 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:34.428864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8c37-af7c-4055-8fb8-7ddce95f0a34 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:34.456961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 885/1804] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:49:34.458642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954771b-4e12-4f8f-b11b-adead448ae81 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:34.459097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954771b-4e12-4f8f-b11b-adead448ae81 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:34.460646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 920/1805] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:34.461148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954771b-4e12-4f8f-b11b-adead448ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:34.471266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1b32-686d-4a71-bc0d-3123f6df8c9d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:34.471865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1b32-686d-4a71-bc0d-3123f6df8c9d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:34.472364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1b32-686d-4a71-bc0d-3123f6df8c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:34.505944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8954771b-4e12-4f8f-b11b-adead448ae81 None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:34.507320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8954771b-4e12-4f8f-b11b-adead448ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:34.542036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-615f1b32-686d-4a71-bc0d-3123f6df8c9d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:34.543977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-615f1b32-686d-4a71-bc0d-3123f6df8c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:34.554305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:34.583967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 921/1806] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:34.584996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f1b32-686d-4a71-bc0d-3123f6df8c9d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:34.594748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-615f1b32-686d-4a71-bc0d-3123f6df8c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:34.652108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f1b32-686d-4a71-bc0d-3123f6df8c9d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:34.684992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a351a6bd9e864ad9b5e719f4492ce0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be226858358948a9871897ec63156a14', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:34.685514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 886/1807] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:49:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:34.686438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:34.686949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:34.687560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] PATH_INFO: `/v3/projects/bf293c905085450382fe1803181e47af` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:34.690430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf293c905085450382fe1803181e47af)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:34.692530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:34.697241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:34.698795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954771b-4e12-4f8f-b11b-adead448ae81 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:34.732225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954771b-4e12-4f8f-b11b-adead448ae81 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:34.746440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:34.761977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:34.762359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:34.762550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:34.763268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:34.763579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:34.765253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:34.831410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 887/1808] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:34.833719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:34.856437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf293c905085450382fe1803181e47af', 'request_id': 'req-feded1c0-9798-4394-855e-bf8109c24685'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.871706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fef40-913e-4e26-840d-538300b08e6c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:34.886330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf293c905085450382fe1803181e47af', 'request_id': 'req-feded1c0-9798-4394-855e-bf8109c24685'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.905942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf293c905085450382fe1803181e47af', 'request_id': 'req-feded1c0-9798-4394-855e-bf8109c24685'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.923585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] The token cache is being invalidate because project bf293c905085450382fe1803181e47af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:34.923965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.924702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:34.931994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 922/1809] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:34 2022] DELETE /identity/v3/projects/bf293c905085450382fe1803181e47af => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:35.043030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:35.049116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:35.097284 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:35.098760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:35.099098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:35.099399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:35.104525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:35.110063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:35.210903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 888/1810] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:34 2022] POST /identity/v3/projects => generated 397 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:35.212489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:35.215457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:35.235414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feded1c0-9798-4394-855e-bf8109c24685 tempest-VolumeQuotaClassesTest-326859372 tempest-VolumeQuotaClassesTest-326859372-project-admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:35.403155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b2b6-1977-4423-a094-5bf7b825f616 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:35.430880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a38c-799d-4262-8766-ef1dec89f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:35.431708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a38c-799d-4262-8766-ef1dec89f72b admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:35.432027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a38c-799d-4262-8766-ef1dec89f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:35.432373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a38c-799d-4262-8766-ef1dec89f72b admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:35.433833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3a38c-799d-4262-8766-ef1dec89f72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:35.438361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:35.439000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:35.439244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3a38c-799d-4262-8766-ef1dec89f72b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:35.439431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:35.439694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:35.441624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:35.476946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:35.481365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:35.501615 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 889/1811] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:35 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:35.502636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a38c-799d-4262-8766-ef1dec89f72b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:35.514092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 923/1812] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:35.553861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:35.555406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:35.560819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a38c-799d-4262-8766-ef1dec89f72b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:35.588386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98126ad-0f60-443c-bf46-43c00038bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:35.600170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98126ad-0f60-443c-bf46-43c00038bb94 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:35.600170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98126ad-0f60-443c-bf46-43c00038bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:35.600170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98126ad-0f60-443c-bf46-43c00038bb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:35.600170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98126ad-0f60-443c-bf46-43c00038bb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:35.602494 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:35.611527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98126ad-0f60-443c-bf46-43c00038bb94 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:35.676580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 890/1813] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:35.680866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98126ad-0f60-443c-bf46-43c00038bb94 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:35.738605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98126ad-0f60-443c-bf46-43c00038bb94 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:35.762453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:35.776402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:35.776839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:35.777132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:35.778191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:35.787108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:35.790549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:35.825323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 891/1814] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:35.826322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:35.866861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:35.882613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3a45f-a641-418d-ad0a-ffd8b3cb6528 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:35.909218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257d03-520f-4114-abb4-775aac37b5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:35.915669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257d03-520f-4114-abb4-775aac37b5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:35.915968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257d03-520f-4114-abb4-775aac37b5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:35.918981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd373d-8a7d-4a45-ac8e-4da94c2e70a2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:35.919188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257d03-520f-4114-abb4-775aac37b5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:35.926927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e1257d03-520f-4114-abb4-775aac37b5f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:35.959073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:35.959745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:35.960027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:35.960302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] PATH_INFO: `/v3/users/e09d18c6d7de48018485dd0804342ed5` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:35.965295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09d18c6d7de48018485dd0804342ed5)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:35.985713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:36.162982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09d18c6d7de48018485dd0804342ed5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:36.166578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09d18c6d7de48018485dd0804342ed5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:36.189751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09d18c6d7de48018485dd0804342ed5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:36.191293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09d18c6d7de48018485dd0804342ed5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:36.221261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09d18c6d7de48018485dd0804342ed5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:36.232747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257d03-520f-4114-abb4-775aac37b5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:36.240570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257d03-520f-4114-abb4-775aac37b5f5 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:36.303054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 892/1815] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:35 2022] DELETE /identity/v3/users/e09d18c6d7de48018485dd0804342ed5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:36.303997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:36.306889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:36.307268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 924/1816] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:36.308882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb28f-af5f-4705-b98b-af0b02a9a658 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:36.309173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb28f-af5f-4705-b98b-af0b02a9a658 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:36.309445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deb28f-af5f-4705-b98b-af0b02a9a658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:36.406948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-26deb28f-af5f-4705-b98b-af0b02a9a658 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:36.410303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-26deb28f-af5f-4705-b98b-af0b02a9a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:36.536225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f24262-66d9-4840-b4b6-100d08ce9948 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:36.560574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20651caa-6c34-4005-860e-380202a1d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:36.561277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651caa-6c34-4005-860e-380202a1d1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:36.561567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651caa-6c34-4005-860e-380202a1d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:36.568364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20651caa-6c34-4005-860e-380202a1d1a8 admin admin] PATH_INFO: `/v3/projects/1523107fa5cf45a995c55db22f0868ac/users/7f891053a9f44cb292246a3444875f79/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:36.605839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20651caa-6c34-4005-860e-380202a1d1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1523107fa5cf45a995c55db22f0868ac, user_id=7f891053a9f44cb292246a3444875f79, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:36.608592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20651caa-6c34-4005-860e-380202a1d1a8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:36.635020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 893/1817] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:36 2022] PUT /identity/v3/projects/1523107fa5cf45a995c55db22f0868ac/users/7f891053a9f44cb292246a3444875f79/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:36.647231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ab80-a524-436c-a46c-f585985612c1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:36.650961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ab80-a524-436c-a46c-f585985612c1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:36.652098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6ab80-a524-436c-a46c-f585985612c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:36.764874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d2e6ab80-a524-436c-a46c-f585985612c1 None None] MFA Rules not processed for user `7f891053a9f44cb292246a3444875f79`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:36.764988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 925/1818] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:36.765444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d2e6ab80-a524-436c-a46c-f585985612c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:36.918556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:36.996623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 894/1819] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:37.001768 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb28f-af5f-4705-b98b-af0b02a9a658 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:37.022152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deb28f-af5f-4705-b98b-af0b02a9a658 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:37.084489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6ab80-a524-436c-a46c-f585985612c1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:37.089867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d2e6ab80-a524-436c-a46c-f585985612c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:37.162225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d0f56-9e40-423d-9889-eed143df045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:37.162861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d0f56-9e40-423d-9889-eed143df045a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:37.163144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d0f56-9e40-423d-9889-eed143df045a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:37.164527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d0f56-9e40-423d-9889-eed143df045a admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:37.165400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d0f56-9e40-423d-9889-eed143df045a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:37.167625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d0f56-9e40-423d-9889-eed143df045a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:37.203114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:37.314100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6ab80-a524-436c-a46c-f585985612c1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:37.327536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037782-282a-41e5-afb8-b3fbcd28c668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:37.329100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037782-282a-41e5-afb8-b3fbcd28c668 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:37.330349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 926/1820] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:37 2022] POST /identity/v3/projects => generated 397 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:37.332971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d0f56-9e40-423d-9889-eed143df045a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:37.341041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037782-282a-41e5-afb8-b3fbcd28c668 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:37.341448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037782-282a-41e5-afb8-b3fbcd28c668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:37.370312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e037782-282a-41e5-afb8-b3fbcd28c668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:37.373225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e037782-282a-41e5-afb8-b3fbcd28c668 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:37.391755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 895/1821] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:37.613561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d0f56-9e40-423d-9889-eed143df045a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:37.641559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4806e-0c08-420e-9f20-1f0c90659b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:37.646784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4806e-0c08-420e-9f20-1f0c90659b78 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:37.647586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4806e-0c08-420e-9f20-1f0c90659b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:37.647873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4806e-0c08-420e-9f20-1f0c90659b78 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:37.650272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4806e-0c08-420e-9f20-1f0c90659b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:37.658637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4806e-0c08-420e-9f20-1f0c90659b78 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:37.727818 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 927/1822] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:37 2022] POST /identity/v3/users => generated 305 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:37.732190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037782-282a-41e5-afb8-b3fbcd28c668 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:37.753709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037782-282a-41e5-afb8-b3fbcd28c668 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:37.772697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885321ca-77ab-410b-8bc8-500924c4c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:37.773341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885321ca-77ab-410b-8bc8-500924c4c29a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:37.773652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885321ca-77ab-410b-8bc8-500924c4c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:37.773930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885321ca-77ab-410b-8bc8-500924c4c29a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:37.774586 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885321ca-77ab-410b-8bc8-500924c4c29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:37.787001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885321ca-77ab-410b-8bc8-500924c4c29a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:37.825335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 896/1823] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:37.828384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4806e-0c08-420e-9f20-1f0c90659b78 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:37.844442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4806e-0c08-420e-9f20-1f0c90659b78 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:37.857213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e76f5-3709-461d-995a-901a10660ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:37.858078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e76f5-3709-461d-995a-901a10660ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:37.858365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e76f5-3709-461d-995a-901a10660ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:37.859754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e76f5-3709-461d-995a-901a10660ad3 admin admin] PATH_INFO: `/v3/projects/5f026883176d46a6b07f8c769027548f/users/e501faa9a8364b418f1f585bb7f862a2/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:37.906801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e76f5-3709-461d-995a-901a10660ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f026883176d46a6b07f8c769027548f, user_id=e501faa9a8364b418f1f585bb7f862a2, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:37.938568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e76f5-3709-461d-995a-901a10660ad3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:37.997176 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 928/1824] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:37 2022] PUT /identity/v3/projects/5f026883176d46a6b07f8c769027548f/users/e501faa9a8364b418f1f585bb7f862a2/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:38.002071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885321ca-77ab-410b-8bc8-500924c4c29a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:38.029876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885321ca-77ab-410b-8bc8-500924c4c29a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:38.258417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b406-cef7-4156-a598-4b8381c5619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:38.259030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b406-cef7-4156-a598-4b8381c5619c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:38.259345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b406-cef7-4156-a598-4b8381c5619c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:38.259619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b406-cef7-4156-a598-4b8381c5619c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:38.278435 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294b406-cef7-4156-a598-4b8381c5619c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:38.288158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294b406-cef7-4156-a598-4b8381c5619c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:38.327197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 897/1825] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:38.330598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e76f5-3709-461d-995a-901a10660ad3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:38.348756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e76f5-3709-461d-995a-901a10660ad3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:38.361438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:38.362154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:38.362435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:38.362711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] PATH_INFO: `/v3/projects/5f026883176d46a6b07f8c769027548f/users/e501faa9a8364b418f1f585bb7f862a2/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:38.367341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f026883176d46a6b07f8c769027548f, user_id=e501faa9a8364b418f1f585bb7f862a2, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:38.370092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:38.406137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 929/1826] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:38 2022] PUT /identity/v3/projects/5f026883176d46a6b07f8c769027548f/users/e501faa9a8364b418f1f585bb7f862a2/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:38.430928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a1318-1053-46ac-9d1f-9f4294ae9a35 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:38.431220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a1318-1053-46ac-9d1f-9f4294ae9a35 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:38.431558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a1318-1053-46ac-9d1f-9f4294ae9a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:38.498104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5e2a1318-1053-46ac-9d1f-9f4294ae9a35 None None] MFA Rules not processed for user `e501faa9a8364b418f1f585bb7f862a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:38.499357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5e2a1318-1053-46ac-9d1f-9f4294ae9a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:38.722655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:38.775841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 898/1827] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:38.824552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:38.827028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:39.054262 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56063-5f52-4cc5-9cd6-f9822d2b7b8c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:39.059281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a217c9-9b0c-420d-8b01-b5463c37250c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:39.059912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a217c9-9b0c-420d-8b01-b5463c37250c service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:39.060191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a217c9-9b0c-420d-8b01-b5463c37250c service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:39.060545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a217c9-9b0c-420d-8b01-b5463c37250c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:39.081725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a217c9-9b0c-420d-8b01-b5463c37250c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:39.084551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a217c9-9b0c-420d-8b01-b5463c37250c service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:39.137392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 930/1828] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:38 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:39.296531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a1318-1053-46ac-9d1f-9f4294ae9a35 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:39.298806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5e2a1318-1053-46ac-9d1f-9f4294ae9a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:39.313492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a1318-1053-46ac-9d1f-9f4294ae9a35 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:39.319161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:39.319807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:39.320091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:39.320525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:39.493682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:39.495186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:39.525177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 899/1829] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:39.603303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b079fc-16e5-47fe-ba17-42c3e3e9f00c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:39.603791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b079fc-16e5-47fe-ba17-42c3e3e9f00c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:39.604390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b079fc-16e5-47fe-ba17-42c3e3e9f00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:39.641861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-72b079fc-16e5-47fe-ba17-42c3e3e9f00c None None] MFA Rules not processed for user `66f98af5c7194ce58dde8258e2ecf945`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:39.643552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-72b079fc-16e5-47fe-ba17-42c3e3e9f00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:39.720873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:39.741095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 931/1830] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:39.813151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:39.814813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:39.953092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071e0c3-5901-47b2-9e28-81b5f3506665 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:39.961713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:39.962534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:39.962827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:39.963109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] PATH_INFO: `/v3/projects/6ef76523ed9742898256695c162bc462` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:39.964581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef76523ed9742898256695c162bc462)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:39.966698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:40.099093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef76523ed9742898256695c162bc462', 'request_id': 'req-f2531d07-ef2a-4ce2-b724-7298f3e23c97'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.117752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef76523ed9742898256695c162bc462', 'request_id': 'req-f2531d07-ef2a-4ce2-b724-7298f3e23c97'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.141579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef76523ed9742898256695c162bc462', 'request_id': 'req-f2531d07-ef2a-4ce2-b724-7298f3e23c97'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.166716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] The token cache is being invalidate because project 6ef76523ed9742898256695c162bc462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:40.167029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.173832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.175812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 900/1831] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:39 2022] DELETE /identity/v3/projects/6ef76523ed9742898256695c162bc462 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:40.181549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b079fc-16e5-47fe-ba17-42c3e3e9f00c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:40.197045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b079fc-16e5-47fe-ba17-42c3e3e9f00c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:40.301824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:40.303028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:40.303309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:40.303622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] PATH_INFO: `/v3/users/a351a6bd9e864ad9b5e719f4492ce0a5` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:40.304955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a351a6bd9e864ad9b5e719f4492ce0a5)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:40.306957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:40.370178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a351a6bd9e864ad9b5e719f4492ce0a5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.370907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a351a6bd9e864ad9b5e719f4492ce0a5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.378775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a351a6bd9e864ad9b5e719f4492ce0a5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.390704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a351a6bd9e864ad9b5e719f4492ce0a5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.423179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-498ddae0-c8b1-4029-babd-d1a9b781a934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a351a6bd9e864ad9b5e719f4492ce0a5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:40.445235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 932/1832] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:40 2022] DELETE /identity/v3/users/a351a6bd9e864ad9b5e719f4492ce0a5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:41.098189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:41.100709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:41.123471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2531d07-ef2a-4ce2-b724-7298f3e23c97 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:41.158309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:41.300591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:41.314453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:41.314751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:41.315036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] PATH_INFO: `/v3/projects/be226858358948a9871897ec63156a14` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:41.321832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be226858358948a9871897ec63156a14)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:41.327168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:41.478526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be226858358948a9871897ec63156a14', 'request_id': 'req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:41.494612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be226858358948a9871897ec63156a14', 'request_id': 'req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:41.518258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be226858358948a9871897ec63156a14', 'request_id': 'req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:41.539234 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] The token cache is being invalidate because project be226858358948a9871897ec63156a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:41.539618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:41.541292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d02d0598-5fd3-4039-8202-a9c9b5a53c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:41.544292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 901/1833] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:41 2022] DELETE /identity/v3/projects/be226858358948a9871897ec63156a14 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:41.548862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb97fb-0cdf-4c46-a746-66c85ab34383 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:41.549772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb97fb-0cdf-4c46-a746-66c85ab34383 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:41.550033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb97fb-0cdf-4c46-a746-66c85ab34383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:41.588064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e4eb97fb-0cdf-4c46-a746-66c85ab34383 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:41.589572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e4eb97fb-0cdf-4c46-a746-66c85ab34383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:41.726930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 933/1834] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:41.727803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bfebd-0388-4cea-a89f-c90d0dfa62fc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:41.728106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bfebd-0388-4cea-a89f-c90d0dfa62fc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:41.728621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bfebd-0388-4cea-a89f-c90d0dfa62fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:41.763099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ed4bfebd-0388-4cea-a89f-c90d0dfa62fc None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:41.764562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ed4bfebd-0388-4cea-a89f-c90d0dfa62fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:41.779017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 902/1835] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:41.779323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb97fb-0cdf-4c46-a746-66c85ab34383 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:41.794619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb97fb-0cdf-4c46-a746-66c85ab34383 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:41.833408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:41.834363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:41.834800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:41.835220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:41.836215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:41.836714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:41.838899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:41.842145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:41.861408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 934/1836] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:41.866484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bfebd-0388-4cea-a89f-c90d0dfa62fc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:41.878592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bfebd-0388-4cea-a89f-c90d0dfa62fc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:41.894971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1622-3ac0-4aaf-a3e3-a3eb0734c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:41.896204 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1622-3ac0-4aaf-a3e3-a3eb0734c75f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:41.896438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1622-3ac0-4aaf-a3e3-a3eb0734c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:41.896724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1622-3ac0-4aaf-a3e3-a3eb0734c75f admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:41.897384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f1622-3ac0-4aaf-a3e3-a3eb0734c75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:41.899619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f1622-3ac0-4aaf-a3e3-a3eb0734c75f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:41.956648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 903/1837] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:41 2022] POST /identity/v3/projects => generated 357 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:41.961213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:41.979085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0862ef-eb27-4798-8faf-7e88051a7135 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:42.113190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2cd7a-961f-4fd6-a141-bb00d01321ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:42.113866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2cd7a-961f-4fd6-a141-bb00d01321ad admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:42.114394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2cd7a-961f-4fd6-a141-bb00d01321ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:42.114835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2cd7a-961f-4fd6-a141-bb00d01321ad admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:42.115219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2cd7a-961f-4fd6-a141-bb00d01321ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:42.120171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2cd7a-961f-4fd6-a141-bb00d01321ad admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:42.164984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 935/1838] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:41 2022] POST /identity/v3/users => generated 279 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:42.168725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1622-3ac0-4aaf-a3e3-a3eb0734c75f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:42.185159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1622-3ac0-4aaf-a3e3-a3eb0734c75f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:42.205367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8b0dd-0371-4225-aafa-65a8a05c0101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:42.206027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8b0dd-0371-4225-aafa-65a8a05c0101 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:42.206315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8b0dd-0371-4225-aafa-65a8a05c0101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:42.206591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8b0dd-0371-4225-aafa-65a8a05c0101 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:42.207258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8b0dd-0371-4225-aafa-65a8a05c0101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:42.209416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8b0dd-0371-4225-aafa-65a8a05c0101 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:42.262334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 904/1839] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:42.266049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2cd7a-961f-4fd6-a141-bb00d01321ad admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:42.282956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2cd7a-961f-4fd6-a141-bb00d01321ad admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:42.298113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69eaf1-2f9b-4ef7-80e8-9244485291af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:42.300553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69eaf1-2f9b-4ef7-80e8-9244485291af admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:42.300923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69eaf1-2f9b-4ef7-80e8-9244485291af admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:42.302386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69eaf1-2f9b-4ef7-80e8-9244485291af admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:42.303156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69eaf1-2f9b-4ef7-80e8-9244485291af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:42.307040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69eaf1-2f9b-4ef7-80e8-9244485291af admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:42.338764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 936/1840] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:42.342255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8b0dd-0371-4225-aafa-65a8a05c0101 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:42.354265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8b0dd-0371-4225-aafa-65a8a05c0101 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:42.364037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:42.365120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:42.367164 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:42.367862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] PATH_INFO: `/v3/projects/fd6bd474d53d462189d105c969ef7661/users/18028e02d03847389c1c73f9d30c3012/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:42.410081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd6bd474d53d462189d105c969ef7661, user_id=18028e02d03847389c1c73f9d30c3012, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:42.432157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:42.458639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 905/1841] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:42 2022] PUT /identity/v3/projects/fd6bd474d53d462189d105c969ef7661/users/18028e02d03847389c1c73f9d30c3012/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:42.466211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831effb-0049-49b7-b52d-85def5ceee16 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:42.466615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831effb-0049-49b7-b52d-85def5ceee16 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:42.466760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831effb-0049-49b7-b52d-85def5ceee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:42.511748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b831effb-0049-49b7-b52d-85def5ceee16 None None] MFA Rules not processed for user `18028e02d03847389c1c73f9d30c3012`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:42.513073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b831effb-0049-49b7-b52d-85def5ceee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:42.586916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 937/1842] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:42.623938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:42.626505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:42.691192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:42.694968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8c93c-34f3-44c9-9103-2f1a4ba693d1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:42.700427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4899cb7-0f34-400a-88d2-7edc7be3960e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:42.701165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899cb7-0f34-400a-88d2-7edc7be3960e service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:42.701479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899cb7-0f34-400a-88d2-7edc7be3960e service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:42.702020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899cb7-0f34-400a-88d2-7edc7be3960e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:42.712959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4899cb7-0f34-400a-88d2-7edc7be3960e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:42.714451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4899cb7-0f34-400a-88d2-7edc7be3960e service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:42.726494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 906/1843] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:42.743345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831effb-0049-49b7-b52d-85def5ceee16 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:42.821735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831effb-0049-49b7-b52d-85def5ceee16 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:42.831021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:42.832492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:42.832627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:42.832917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] PATH_INFO: `/v3/users/18028e02d03847389c1c73f9d30c3012` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:42.835030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] RBAC: Authorizing `identity:delete_user(user_id=18028e02d03847389c1c73f9d30c3012)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:42.837469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:42.844205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:42.901085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18028e02d03847389c1c73f9d30c3012'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:42.901895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18028e02d03847389c1c73f9d30c3012'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:42.911088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18028e02d03847389c1c73f9d30c3012'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:42.912006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18028e02d03847389c1c73f9d30c3012'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:42.934165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18028e02d03847389c1c73f9d30c3012'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:42.958344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 938/1844] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:42 2022] DELETE /identity/v3/users/18028e02d03847389c1c73f9d30c3012 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:42.962729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b80f-b4f8-487b-ba6f-86a9f50efebf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:42.963241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b80f-b4f8-487b-ba6f-86a9f50efebf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:42.963667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b80f-b4f8-487b-ba6f-86a9f50efebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:43.011143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-16f1b80f-b4f8-487b-ba6f-86a9f50efebf None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:43.013013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-16f1b80f-b4f8-487b-ba6f-86a9f50efebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:43.127336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 907/1845] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:43.164802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:43.166558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:43.258287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0b984-74f3-4e03-bb07-779fd691ebed admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:43.267235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba6653-4c50-4451-9f65-1adf4d60226c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:43.268094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6653-4c50-4451-9f65-1adf4d60226c service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:43.268677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6653-4c50-4451-9f65-1adf4d60226c service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:43.269102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba6653-4c50-4451-9f65-1adf4d60226c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:43.297833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba6653-4c50-4451-9f65-1adf4d60226c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:43.303431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba6653-4c50-4451-9f65-1adf4d60226c service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:43.351412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 939/1846] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:43.384136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270faee6-7770-4492-b63d-ab7d5d59c258 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:43.384624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270faee6-7770-4492-b63d-ab7d5d59c258 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:43.384724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270faee6-7770-4492-b63d-ab7d5d59c258 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:43.387830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 908/1847] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:43.597705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a028cb-a752-4211-a758-2d591910903b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:43.598173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a028cb-a752-4211-a758-2d591910903b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:43.599541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a028cb-a752-4211-a758-2d591910903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:43.681922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-55a028cb-a752-4211-a758-2d591910903b None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:43.683348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-55a028cb-a752-4211-a758-2d591910903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:43.855152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 940/1848] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:49:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:44.191665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270faee6-7770-4492-b63d-ab7d5d59c258 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:44.194140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-270faee6-7770-4492-b63d-ab7d5d59c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:44.233991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270faee6-7770-4492-b63d-ab7d5d59c258 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:44.252422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:44.253313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:44.254319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:44.254921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:44.269099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:44.271685 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:44.300631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 909/1849] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:44.491274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a028cb-a752-4211-a758-2d591910903b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:44.493037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-55a028cb-a752-4211-a758-2d591910903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:44.516197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a028cb-a752-4211-a758-2d591910903b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:44.529335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:44.530038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:44.530428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:44.530673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] PATH_INFO: `/v3/projects/fd6bd474d53d462189d105c969ef7661` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:44.532362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:44.533920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:44.546567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd6bd474d53d462189d105c969ef7661)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:44.548569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:44.563529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047c56a-6e17-4a11-83c2-00c4148839a0 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:44.564645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:44.571755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:44.572930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:44.573590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:44.574305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] PATH_INFO: `/v3/users/7f891053a9f44cb292246a3444875f79` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:44.577255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f891053a9f44cb292246a3444875f79)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:44.579587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:44.672419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd6bd474d53d462189d105c969ef7661', 'request_id': 'req-13ac49b6-1700-4116-b73b-85e3ae1dd690'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.677168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f891053a9f44cb292246a3444875f79'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.679517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f891053a9f44cb292246a3444875f79'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.684553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd6bd474d53d462189d105c969ef7661', 'request_id': 'req-13ac49b6-1700-4116-b73b-85e3ae1dd690'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.694792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f891053a9f44cb292246a3444875f79'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.695528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f891053a9f44cb292246a3444875f79'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.699088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd6bd474d53d462189d105c969ef7661', 'request_id': 'req-13ac49b6-1700-4116-b73b-85e3ae1dd690'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.709305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3392ecf4-677a-4d05-a001-3ba220496bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f891053a9f44cb292246a3444875f79'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.725639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] The token cache is being invalidate because project fd6bd474d53d462189d105c969ef7661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:44.725940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.727359 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13ac49b6-1700-4116-b73b-85e3ae1dd690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:44.731424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 941/1850] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:44 2022] DELETE /identity/v3/projects/fd6bd474d53d462189d105c969ef7661 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:44.735669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691264-fa25-4154-b15c-e4d19e73d980 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:44.735952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691264-fa25-4154-b15c-e4d19e73d980 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:44.736222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73691264-fa25-4154-b15c-e4d19e73d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:44.751814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 910/1851] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:44 2022] DELETE /identity/v3/users/7f891053a9f44cb292246a3444875f79 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:44.753287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00faef5-5504-4e65-b3ce-05189d49f759 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:44.753575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00faef5-5504-4e65-b3ce-05189d49f759 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:44.753885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00faef5-5504-4e65-b3ce-05189d49f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:44.782999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-73691264-fa25-4154-b15c-e4d19e73d980 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:44.785246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-73691264-fa25-4154-b15c-e4d19e73d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:44.804488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b00faef5-5504-4e65-b3ce-05189d49f759 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:44.810091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b00faef5-5504-4e65-b3ce-05189d49f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:44.976137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:44.986642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 942/1852] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:44.988144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c4ca-902c-4c36-a8a4-89761899fa58 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:44.988437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c4ca-902c-4c36-a8a4-89761899fa58 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:44.988899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326c4ca-902c-4c36-a8a4-89761899fa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.022494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 911/1853] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:45.039634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00faef5-5504-4e65-b3ce-05189d49f759 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:45.044770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b00faef5-5504-4e65-b3ce-05189d49f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:45.051899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a326c4ca-902c-4c36-a8a4-89761899fa58 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:45.053483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a326c4ca-902c-4c36-a8a4-89761899fa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:45.081155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 943/1854] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:45.086049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326c4ca-902c-4c36-a8a4-89761899fa58 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:45.113508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326c4ca-902c-4c36-a8a4-89761899fa58 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:45.132104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:45.132705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.133811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.134148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.136672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:45.136988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:45.141261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:45.174979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 944/1855] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:45.176521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:45.177422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00faef5-5504-4e65-b3ce-05189d49f759 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:45.186261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e749ebb-1c09-447c-92a2-69917cd1fdb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:45.187598 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e749ebb-1c09-447c-92a2-69917cd1fdb6 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.190076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e749ebb-1c09-447c-92a2-69917cd1fdb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.190374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e749ebb-1c09-447c-92a2-69917cd1fdb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.212607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8b5c-36bd-4177-bc7b-78a2dc3e7606 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:45.222245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54df8-9274-440d-856e-237940785c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:45.222882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54df8-9274-440d-856e-237940785c41 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.224750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54df8-9274-440d-856e-237940785c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.225049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54df8-9274-440d-856e-237940785c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.226227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e749ebb-1c09-447c-92a2-69917cd1fdb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:45.227699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad54df8-9274-440d-856e-237940785c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:45.229133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e749ebb-1c09-447c-92a2-69917cd1fdb6 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:45.237087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad54df8-9274-440d-856e-237940785c41 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:45.262560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 912/1856] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:49:45.307963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e749ebb-1c09-447c-92a2-69917cd1fdb6 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:45.315450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 945/1857] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:45 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:45.321231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e749ebb-1c09-447c-92a2-69917cd1fdb6 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:45.405189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c66293-b117-42e8-b365-a0f0cbdab384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:45.405879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c66293-b117-42e8-b365-a0f0cbdab384 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.406166 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c66293-b117-42e8-b365-a0f0cbdab384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.406441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c66293-b117-42e8-b365-a0f0cbdab384 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.407084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c66293-b117-42e8-b365-a0f0cbdab384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:45.409124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c66293-b117-42e8-b365-a0f0cbdab384 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:45.447093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54df8-9274-440d-856e-237940785c41 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:45.458889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 913/1858] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:45 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:45.463040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54df8-9274-440d-856e-237940785c41 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:45.468150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bdaaf-ce2f-461f-b2ff-497d65bdfdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:45.469131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bdaaf-ce2f-461f-b2ff-497d65bdfdbe admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.469492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bdaaf-ce2f-461f-b2ff-497d65bdfdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.470096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bdaaf-ce2f-461f-b2ff-497d65bdfdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.470570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bdaaf-ce2f-461f-b2ff-497d65bdfdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:45.478647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bdaaf-ce2f-461f-b2ff-497d65bdfdbe admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:45.502846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 946/1859] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:45.504404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c66293-b117-42e8-b365-a0f0cbdab384 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:45.527182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c66293-b117-42e8-b365-a0f0cbdab384 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:45.533559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c92a36-eb93-41cc-8eac-267c6b394a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:45.534284 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92a36-eb93-41cc-8eac-267c6b394a41 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.534776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92a36-eb93-41cc-8eac-267c6b394a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.535090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c92a36-eb93-41cc-8eac-267c6b394a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.535766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c92a36-eb93-41cc-8eac-267c6b394a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:45.538426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c92a36-eb93-41cc-8eac-267c6b394a41 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:45.554583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 914/1860] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:45.561578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bdaaf-ce2f-461f-b2ff-497d65bdfdbe admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:45.585820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bdaaf-ce2f-461f-b2ff-497d65bdfdbe admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:45.592651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:45.593948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.594539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.595017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] PATH_INFO: `/v3/projects/a55d93cc3dbd497485aae3ad92d33291/users/15358554fdf84238b830387571e4736a/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.638139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55d93cc3dbd497485aae3ad92d33291, user_id=15358554fdf84238b830387571e4736a, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:45.641372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:45.658150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 947/1861] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:45 2022] PUT /identity/v3/projects/a55d93cc3dbd497485aae3ad92d33291/users/15358554fdf84238b830387571e4736a/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:45.671509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ef8-a9b6-4993-9804-813e778deca0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.672262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ef8-a9b6-4993-9804-813e778deca0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.672262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145ef8-a9b6-4993-9804-813e778deca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.711738 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-48145ef8-a9b6-4993-9804-813e778deca0 None None] MFA Rules not processed for user `15358554fdf84238b830387571e4736a`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:45.713225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-48145ef8-a9b6-4993-9804-813e778deca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:45.831613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 915/1862] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:45.840711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:45.842520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:45.896991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:45.947229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd30ec-0d83-4786-87db-8ed04fbbd400 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:45.951857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9ba77-9715-470b-aa9a-32fe5459b21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:45.952596 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ba77-9715-470b-aa9a-32fe5459b21b service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:45.953200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ba77-9715-470b-aa9a-32fe5459b21b service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:45.953664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ba77-9715-470b-aa9a-32fe5459b21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:45.964651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9ba77-9715-470b-aa9a-32fe5459b21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:45.966623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9ba77-9715-470b-aa9a-32fe5459b21b service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:45.980315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 948/1863] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:46.548820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145ef8-a9b6-4993-9804-813e778deca0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:46.550818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-48145ef8-a9b6-4993-9804-813e778deca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:46.557833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:46.766796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145ef8-a9b6-4993-9804-813e778deca0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:46.782852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:46.783856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:46.787098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:46.787545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] PATH_INFO: `/v3/projects/1523107fa5cf45a995c55db22f0868ac` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:46.790629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1523107fa5cf45a995c55db22f0868ac)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:46.799391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:46.898900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1523107fa5cf45a995c55db22f0868ac', 'request_id': 'req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:46.910206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1523107fa5cf45a995c55db22f0868ac', 'request_id': 'req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:46.924616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1523107fa5cf45a995c55db22f0868ac', 'request_id': 'req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:46.963835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996ddb1-8b74-47f4-bfdc-2a421831fc4e None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:46.964304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996ddb1-8b74-47f4-bfdc-2a421831fc4e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:46.964596 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996ddb1-8b74-47f4-bfdc-2a421831fc4e None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:46.966785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 949/1864] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:49:46.967964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] The token cache is being invalidate because project 1523107fa5cf45a995c55db22f0868ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:46.976068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:46.977507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-3d53e4ca-de09-4cee-a9dd-f5768b5ecb8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:46.984589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 916/1865] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:46 2022] DELETE /identity/v3/projects/1523107fa5cf45a995c55db22f0868ac => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:46.985546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996ddb1-8b74-47f4-bfdc-2a421831fc4e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:46.989108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a996ddb1-8b74-47f4-bfdc-2a421831fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:47.013348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352379e-749c-4015-94ce-945363c54de1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:47.014485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352379e-749c-4015-94ce-945363c54de1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:47.014844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352379e-749c-4015-94ce-945363c54de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:47.063524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2352379e-749c-4015-94ce-945363c54de1 None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:47.064787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2352379e-749c-4015-94ce-945363c54de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:47.199559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 917/1866] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:49:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:47.206406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996ddb1-8b74-47f4-bfdc-2a421831fc4e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:47.212272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:47.213371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:47.213717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:47.214178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] PATH_INFO: `/v3/users/e501faa9a8364b418f1f585bb7f862a2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:47.216328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e501faa9a8364b418f1f585bb7f862a2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:47.218524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:47.278635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352379e-749c-4015-94ce-945363c54de1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:47.280161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2352379e-749c-4015-94ce-945363c54de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:47.295077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352379e-749c-4015-94ce-945363c54de1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:47.302430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd540-4c43-467b-a413-296fd5c7ec27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:47.303058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd540-4c43-467b-a413-296fd5c7ec27 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:47.303779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd540-4c43-467b-a413-296fd5c7ec27 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:47.303779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccd540-4c43-467b-a413-296fd5c7ec27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:47.308879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e501faa9a8364b418f1f585bb7f862a2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:47.309985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e501faa9a8364b418f1f585bb7f862a2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:47.313950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccd540-4c43-467b-a413-296fd5c7ec27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:47.315890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccd540-4c43-467b-a413-296fd5c7ec27 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:47.319847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e501faa9a8364b418f1f585bb7f862a2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:47.321546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e501faa9a8364b418f1f585bb7f862a2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:47.327904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 918/1867] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:49:47.337505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-038e7f96-685b-420c-a4d9-ff1ee0051f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e501faa9a8364b418f1f585bb7f862a2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:47.353783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 950/1868] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:46 2022] DELETE /identity/v3/users/e501faa9a8364b418f1f585bb7f862a2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:48.146714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd540-4c43-467b-a413-296fd5c7ec27 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:48.166637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccd540-4c43-467b-a413-296fd5c7ec27 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:48.200308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:48.322979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:48.325385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.326082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.326677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] PATH_INFO: `/v3/projects/5f026883176d46a6b07f8c769027548f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:48.328419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f026883176d46a6b07f8c769027548f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:48.331510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:48.459980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f026883176d46a6b07f8c769027548f', 'request_id': 'req-33f06cb8-1890-42f3-a617-be8df59a65e7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:48.468546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f026883176d46a6b07f8c769027548f', 'request_id': 'req-33f06cb8-1890-42f3-a617-be8df59a65e7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:48.483475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f026883176d46a6b07f8c769027548f', 'request_id': 'req-33f06cb8-1890-42f3-a617-be8df59a65e7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:48.503341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] The token cache is being invalidate because project 5f026883176d46a6b07f8c769027548f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:48.503737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:48.504727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-33f06cb8-1890-42f3-a617-be8df59a65e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:48.506825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 919/1869] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:48 2022] DELETE /identity/v3/projects/5f026883176d46a6b07f8c769027548f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:48.511516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55995cc3-1279-41d1-a19f-61ff246c0dfe None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.511988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55995cc3-1279-41d1-a19f-61ff246c0dfe None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.512178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55995cc3-1279-41d1-a19f-61ff246c0dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:48.544068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-55995cc3-1279-41d1-a19f-61ff246c0dfe None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:48.545305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-55995cc3-1279-41d1-a19f-61ff246c0dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:48.592787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:48.618537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 951/1870] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:48.626673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80329e-1f96-4533-8051-53ce0dd18520 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.626969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80329e-1f96-4533-8051-53ce0dd18520 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.627278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80329e-1f96-4533-8051-53ce0dd18520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:48.649569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8d80329e-1f96-4533-8051-53ce0dd18520 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:48.650866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8d80329e-1f96-4533-8051-53ce0dd18520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:48.660076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 920/1871] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:48.665415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55995cc3-1279-41d1-a19f-61ff246c0dfe None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:48.675021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55995cc3-1279-41d1-a19f-61ff246c0dfe None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:48.680679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:48.681298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.681580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.681897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:48.682551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:48.682855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:48.684626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:48.700516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 952/1872] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:48.701753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80329e-1f96-4533-8051-53ce0dd18520 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:48.711484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80329e-1f96-4533-8051-53ce0dd18520 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:48.716691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6809fca-408d-472c-bb69-8e7c744885de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:48.717474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809fca-408d-472c-bb69-8e7c744885de admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.717790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809fca-408d-472c-bb69-8e7c744885de admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.718084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6809fca-408d-472c-bb69-8e7c744885de admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:48.718724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6809fca-408d-472c-bb69-8e7c744885de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:48.720704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6809fca-408d-472c-bb69-8e7c744885de admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:48.749297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 921/1873] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:48 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:48.753342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:48.763190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c071c-491a-458f-9fd5-be09785b3c00 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:48.820414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95e9c-052d-4d89-9685-0314aa254cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:48.821074 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95e9c-052d-4d89-9685-0314aa254cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.821363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95e9c-052d-4d89-9685-0314aa254cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.821665 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d95e9c-052d-4d89-9685-0314aa254cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:48.822338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95e9c-052d-4d89-9685-0314aa254cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:48.824283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d95e9c-052d-4d89-9685-0314aa254cc8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:48.848511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 953/1874] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:48 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:48.853324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6809fca-408d-472c-bb69-8e7c744885de admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:48.870689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6809fca-408d-472c-bb69-8e7c744885de admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:48.876688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d1f0-9e4d-432b-b967-40aca14ba54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:48.876963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d1f0-9e4d-432b-b967-40aca14ba54a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.877256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d1f0-9e4d-432b-b967-40aca14ba54a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.877536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d1f0-9e4d-432b-b967-40aca14ba54a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:48.878360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2d1f0-9e4d-432b-b967-40aca14ba54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:48.880785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2d1f0-9e4d-432b-b967-40aca14ba54a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:48.896554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 922/1875] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:48.899994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95e9c-052d-4d89-9685-0314aa254cc8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:48.911170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d95e9c-052d-4d89-9685-0314aa254cc8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:48.919208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0195-3453-49c9-a175-b407b545e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:48.919970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0195-3453-49c9-a175-b407b545e358 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.920260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0195-3453-49c9-a175-b407b545e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.920538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0195-3453-49c9-a175-b407b545e358 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:48.921208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f0195-3453-49c9-a175-b407b545e358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:48.922882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f0195-3453-49c9-a175-b407b545e358 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:48.940960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d1f0-9e4d-432b-b967-40aca14ba54a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:48.941413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 954/1876] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:48.954170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d1f0-9e4d-432b-b967-40aca14ba54a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:48.960697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf83e6-bb83-4853-ad4b-d36f543d0cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:48.961553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf83e6-bb83-4853-ad4b-d36f543d0cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:48.961914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf83e6-bb83-4853-ad4b-d36f543d0cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:48.962326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf83e6-bb83-4853-ad4b-d36f543d0cbb admin admin] PATH_INFO: `/v3/projects/49e59673f7ef4f13a5ff6419f5f0ebf4/users/bc489f60f28b48109b6a13c3ff58d3e4/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:49.000985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf83e6-bb83-4853-ad4b-d36f543d0cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e59673f7ef4f13a5ff6419f5f0ebf4, user_id=bc489f60f28b48109b6a13c3ff58d3e4, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:49.003750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf83e6-bb83-4853-ad4b-d36f543d0cbb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:49.033295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 923/1877] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:48 2022] PUT /identity/v3/projects/49e59673f7ef4f13a5ff6419f5f0ebf4/users/bc489f60f28b48109b6a13c3ff58d3e4/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:49.036895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b324c-d239-4504-bc55-7b056fae14b7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:49.042305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b324c-d239-4504-bc55-7b056fae14b7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:49.043474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b324c-d239-4504-bc55-7b056fae14b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:49.087560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-657b324c-d239-4504-bc55-7b056fae14b7 None None] MFA Rules not processed for user `bc489f60f28b48109b6a13c3ff58d3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:49.089179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-657b324c-d239-4504-bc55-7b056fae14b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:49.191748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 955/1878] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:49.196407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf83e6-bb83-4853-ad4b-d36f543d0cbb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:49.250225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:49.275130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf83e6-bb83-4853-ad4b-d36f543d0cbb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:49.279931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ec85b-40c6-468b-ab43-5d0978412e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:49.280549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec85b-40c6-468b-ab43-5d0978412e7c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:49.280832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec85b-40c6-468b-ab43-5d0978412e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:49.281108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ec85b-40c6-468b-ab43-5d0978412e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:49.281784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ec85b-40c6-468b-ab43-5d0978412e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:49.283702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ec85b-40c6-468b-ab43-5d0978412e7c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:49.310501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 924/1879] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:49 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:49.314717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b324c-d239-4504-bc55-7b056fae14b7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:49.337316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b324c-d239-4504-bc55-7b056fae14b7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:49.405354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:49.425303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b272f-4025-40c0-acb3-c0046b315233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:49.425979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b272f-4025-40c0-acb3-c0046b315233 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:49.426313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b272f-4025-40c0-acb3-c0046b315233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:49.426767 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b272f-4025-40c0-acb3-c0046b315233 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:49.427473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b272f-4025-40c0-acb3-c0046b315233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:49.429630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b272f-4025-40c0-acb3-c0046b315233 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:49.474276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 956/1880] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:49 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:49.475309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ec85b-40c6-468b-ab43-5d0978412e7c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:49.485841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ec85b-40c6-468b-ab43-5d0978412e7c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:49.491066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0062f-b4ed-4a5c-84b9-4152fb2ca45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:49.491681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0062f-b4ed-4a5c-84b9-4152fb2ca45f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:49.492048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0062f-b4ed-4a5c-84b9-4152fb2ca45f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:49.492435 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0062f-b4ed-4a5c-84b9-4152fb2ca45f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:49.499364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0062f-b4ed-4a5c-84b9-4152fb2ca45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:49.501059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0062f-b4ed-4a5c-84b9-4152fb2ca45f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:49.516184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 925/1881] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:49.519921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b272f-4025-40c0-acb3-c0046b315233 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:49.533720 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b272f-4025-40c0-acb3-c0046b315233 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:49.546138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18dcab-ba8d-4a1b-8911-ba6641ae3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:49.546899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18dcab-ba8d-4a1b-8911-ba6641ae3d8c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:49.547181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18dcab-ba8d-4a1b-8911-ba6641ae3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:49.548153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18dcab-ba8d-4a1b-8911-ba6641ae3d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:49.548816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18dcab-ba8d-4a1b-8911-ba6641ae3d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:49.567887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18dcab-ba8d-4a1b-8911-ba6641ae3d8c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:49.602398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0062f-b4ed-4a5c-84b9-4152fb2ca45f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:49.602547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 957/1882] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:49.635315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0062f-b4ed-4a5c-84b9-4152fb2ca45f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:49.659459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118a3f5-1857-49aa-bc06-02f79910c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:49.660078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118a3f5-1857-49aa-bc06-02f79910c113 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:49.660530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118a3f5-1857-49aa-bc06-02f79910c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:49.660812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118a3f5-1857-49aa-bc06-02f79910c113 admin admin] PATH_INFO: `/v3/projects/055b900e6fc6474fa25d6d6e4c0da612/users/109151a90dd74b3d8113729e2329c9b2/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:49.693980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118a3f5-1857-49aa-bc06-02f79910c113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055b900e6fc6474fa25d6d6e4c0da612, user_id=109151a90dd74b3d8113729e2329c9b2, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:49.696867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118a3f5-1857-49aa-bc06-02f79910c113 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:49.727747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 926/1883] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:49 2022] PUT /identity/v3/projects/055b900e6fc6474fa25d6d6e4c0da612/users/109151a90dd74b3d8113729e2329c9b2/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:49.739711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b73562-b475-484c-89d9-de5afb6a3851 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:49.739997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b73562-b475-484c-89d9-de5afb6a3851 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:49.740483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b73562-b475-484c-89d9-de5afb6a3851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:49.799700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-14b73562-b475-484c-89d9-de5afb6a3851 None None] MFA Rules not processed for user `109151a90dd74b3d8113729e2329c9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:49.802257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-14b73562-b475-484c-89d9-de5afb6a3851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:49.931362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 958/1884] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:49.935851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118a3f5-1857-49aa-bc06-02f79910c113 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:50.017911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118a3f5-1857-49aa-bc06-02f79910c113 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:50.023867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46204c3e-3fd8-456a-9f60-8e43dbc71df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:50.024521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46204c3e-3fd8-456a-9f60-8e43dbc71df4 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.024810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46204c3e-3fd8-456a-9f60-8e43dbc71df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.025093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46204c3e-3fd8-456a-9f60-8e43dbc71df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.025776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46204c3e-3fd8-456a-9f60-8e43dbc71df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:50.027739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46204c3e-3fd8-456a-9f60-8e43dbc71df4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:50.059661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 927/1885] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:49 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:49:50.064464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b73562-b475-484c-89d9-de5afb6a3851 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:50.076937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b73562-b475-484c-89d9-de5afb6a3851 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:50.140541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6cd5e-ce52-471a-9201-9e0248be8a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:50.141342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6cd5e-ce52-471a-9201-9e0248be8a44 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.141859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6cd5e-ce52-471a-9201-9e0248be8a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.142390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6cd5e-ce52-471a-9201-9e0248be8a44 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.143213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6cd5e-ce52-471a-9201-9e0248be8a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:50.146010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6cd5e-ce52-471a-9201-9e0248be8a44 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:50.174256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 959/1886] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:50 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:50.178768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46204c3e-3fd8-456a-9f60-8e43dbc71df4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:50.196478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46204c3e-3fd8-456a-9f60-8e43dbc71df4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:50.203792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050ce46-ae36-48c1-9a22-287fc16e678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:50.205337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050ce46-ae36-48c1-9a22-287fc16e678a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.205887 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050ce46-ae36-48c1-9a22-287fc16e678a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.208460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050ce46-ae36-48c1-9a22-287fc16e678a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.209578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050ce46-ae36-48c1-9a22-287fc16e678a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:50.212254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050ce46-ae36-48c1-9a22-287fc16e678a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:50.230016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 928/1887] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:50.236221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6cd5e-ce52-471a-9201-9e0248be8a44 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:50.248771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6cd5e-ce52-471a-9201-9e0248be8a44 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:50.284178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb5701-9b19-4a22-9bab-1c69f5f8f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:50.285480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb5701-9b19-4a22-9bab-1c69f5f8f7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.288547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb5701-9b19-4a22-9bab-1c69f5f8f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.289002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb5701-9b19-4a22-9bab-1c69f5f8f7eb admin admin] PATH_INFO: `/v3/projects/7c4b70a9bc1f4465abab3e122578fe63/users/3e0bde6c83034dd280506963fbd43468/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.320268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb5701-9b19-4a22-9bab-1c69f5f8f7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4b70a9bc1f4465abab3e122578fe63, user_id=3e0bde6c83034dd280506963fbd43468, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:50.323567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb5701-9b19-4a22-9bab-1c69f5f8f7eb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:50.355214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 960/1888] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:50 2022] PUT /identity/v3/projects/7c4b70a9bc1f4465abab3e122578fe63/users/3e0bde6c83034dd280506963fbd43468/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:50.358797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050ce46-ae36-48c1-9a22-287fc16e678a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:50.379701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050ce46-ae36-48c1-9a22-287fc16e678a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:50.495840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0e402-90ea-4ba7-91b8-288559e46320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:50.498333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e402-90ea-4ba7-91b8-288559e46320 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.498872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e402-90ea-4ba7-91b8-288559e46320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.499430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e402-90ea-4ba7-91b8-288559e46320 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.500464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0e402-90ea-4ba7-91b8-288559e46320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:50.502241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0e402-90ea-4ba7-91b8-288559e46320 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:50.506133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:50.521871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 929/1889] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:50.523341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb5701-9b19-4a22-9bab-1c69f5f8f7eb admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:50.534820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb5701-9b19-4a22-9bab-1c69f5f8f7eb admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:50.545811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:50.547016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.547567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.548164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] PATH_INFO: `/v3/projects/7c4b70a9bc1f4465abab3e122578fe63/users/3e0bde6c83034dd280506963fbd43468/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.552356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4b70a9bc1f4465abab3e122578fe63, user_id=3e0bde6c83034dd280506963fbd43468, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:50.557759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:50.585086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 961/1890] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:50 2022] PUT /identity/v3/projects/7c4b70a9bc1f4465abab3e122578fe63/users/3e0bde6c83034dd280506963fbd43468/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:50.595152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c0ca8-f884-4b32-93de-d51afdf4a657 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.595718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c0ca8-f884-4b32-93de-d51afdf4a657 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.596168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c0ca8-f884-4b32-93de-d51afdf4a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.637361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d58c0ca8-f884-4b32-93de-d51afdf4a657 None None] MFA Rules not processed for user `3e0bde6c83034dd280506963fbd43468`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:50.638712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d58c0ca8-f884-4b32-93de-d51afdf4a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:50.723000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 930/1891] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:50.733750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:50.735571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:50.742064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:50.818606 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b86004-1f84-4986-90cf-589c5a017897 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:50.825093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:50.826202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.826777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.827880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.844091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:50.845823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:50.859403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 962/1892] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:50.904324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c0ca8-f884-4b32-93de-d51afdf4a657 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:50.905862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d58c0ca8-f884-4b32-93de-d51afdf4a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:50.920083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c0ca8-f884-4b32-93de-d51afdf4a657 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:50.924018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7155e-564e-4261-aebc-6d092d58e988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:50.924263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7155e-564e-4261-aebc-6d092d58e988 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:50.924540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7155e-564e-4261-aebc-6d092d58e988 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:50.924814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7155e-564e-4261-aebc-6d092d58e988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:50.996127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7155e-564e-4261-aebc-6d092d58e988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:50.997944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7155e-564e-4261-aebc-6d092d58e988 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:51.010052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 931/1893] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:51.648229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:51.651556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:51.819604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27c28-8473-43a3-b059-5025eed85e7a service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:51.834123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:51.835842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:51.836039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:51.836313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] PATH_INFO: `/v3/users/62903eb243d945bcbde3486f4ac3da9a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:51.840805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62903eb243d945bcbde3486f4ac3da9a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:51.846351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:51.934744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62903eb243d945bcbde3486f4ac3da9a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:51.935934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62903eb243d945bcbde3486f4ac3da9a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:51.947910 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62903eb243d945bcbde3486f4ac3da9a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:51.949129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62903eb243d945bcbde3486f4ac3da9a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:51.965076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62903eb243d945bcbde3486f4ac3da9a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:51.989729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 963/1894] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:51 2022] DELETE /identity/v3/users/62903eb243d945bcbde3486f4ac3da9a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:51.991397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3adf0-fc34-405d-b200-e23e2d0e1913 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:51.994602 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3adf0-fc34-405d-b200-e23e2d0e1913 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:51.994971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3adf0-fc34-405d-b200-e23e2d0e1913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:52.014634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-64a3adf0-fc34-405d-b200-e23e2d0e1913 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:52.015915 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-64a3adf0-fc34-405d-b200-e23e2d0e1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:52.102211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 932/1895] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:52.113329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:52.115661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:52.170950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:52.236294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2dd6-1bfb-427b-8259-da9892f3e823 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:52.244315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666b45-c008-407c-899f-7793987672f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:52.245191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666b45-c008-407c-899f-7793987672f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:52.245513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666b45-c008-407c-899f-7793987672f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:52.245923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b666b45-c008-407c-899f-7793987672f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:52.263032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b666b45-c008-407c-899f-7793987672f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:52.264984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b666b45-c008-407c-899f-7793987672f4 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:52.296304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 964/1896] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:49:52.831530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3adf0-fc34-405d-b200-e23e2d0e1913 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:52.833410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-64a3adf0-fc34-405d-b200-e23e2d0e1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:52.864650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3adf0-fc34-405d-b200-e23e2d0e1913 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:52.873910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:52.874597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:52.874928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:52.875203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] PATH_INFO: `/v3/projects/5e3e38c9e35a4d1582a6cf9761fd0a82` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:52.876367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3e38c9e35a4d1582a6cf9761fd0a82)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:52.878333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:52.901591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:52.953334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3e38c9e35a4d1582a6cf9761fd0a82', 'request_id': 'req-780e2ec8-d7c7-4248-83f3-b7a8997253bb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:52.961026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3e38c9e35a4d1582a6cf9761fd0a82', 'request_id': 'req-780e2ec8-d7c7-4248-83f3-b7a8997253bb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:52.976858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3e38c9e35a4d1582a6cf9761fd0a82', 'request_id': 'req-780e2ec8-d7c7-4248-83f3-b7a8997253bb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:53.042232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] The token cache is being invalidate because project 5e3e38c9e35a4d1582a6cf9761fd0a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:53.042751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:53.046799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:53.057649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 933/1897] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:52 2022] DELETE /identity/v3/projects/5e3e38c9e35a4d1582a6cf9761fd0a82 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:53.059524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666b45-c008-407c-899f-7793987672f4 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:53.095967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b666b45-c008-407c-899f-7793987672f4 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:53.254520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:53.258695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:53.258970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:53.259255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] PATH_INFO: `/v3/users/61b86e4b80b04df58de44c5099f933c1` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:53.260563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b86e4b80b04df58de44c5099f933c1)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:53.266715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:53.335077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b86e4b80b04df58de44c5099f933c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:53.336068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b86e4b80b04df58de44c5099f933c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:53.349214 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b86e4b80b04df58de44c5099f933c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:53.350003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b86e4b80b04df58de44c5099f933c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:53.387004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8dea8520-5121-4c5d-b920-d0542c4ca4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b86e4b80b04df58de44c5099f933c1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:53.430712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 965/1898] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:53 2022] DELETE /identity/v3/users/61b86e4b80b04df58de44c5099f933c1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:53.938726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:53.940606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:53.961033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e2ec8-d7c7-4248-83f3-b7a8997253bb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.016721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.017356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.017680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.017946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] PATH_INFO: `/v3/projects/83f6cb287830466cb9093ff92d3dd1bd` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.019053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f6cb287830466cb9093ff92d3dd1bd)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.021847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.070164 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f6cb287830466cb9093ff92d3dd1bd', 'request_id': 'req-9ff603be-4f65-4b96-b0d9-3d719da71e61'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:54.075804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f6cb287830466cb9093ff92d3dd1bd', 'request_id': 'req-9ff603be-4f65-4b96-b0d9-3d719da71e61'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:54.084707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f6cb287830466cb9093ff92d3dd1bd', 'request_id': 'req-9ff603be-4f65-4b96-b0d9-3d719da71e61'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:54.097205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] The token cache is being invalidate because project 83f6cb287830466cb9093ff92d3dd1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:54.097475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:54.098208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-9ff603be-4f65-4b96-b0d9-3d719da71e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:54.099775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 934/1899] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:53 2022] DELETE /identity/v3/projects/83f6cb287830466cb9093ff92d3dd1bd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:54.104776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87a1b5-2dca-4b50-a815-f10af4934e4d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.105273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87a1b5-2dca-4b50-a815-f10af4934e4d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.105408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87a1b5-2dca-4b50-a815-f10af4934e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.125995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ed87a1b5-2dca-4b50-a815-f10af4934e4d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:54.127227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ed87a1b5-2dca-4b50-a815-f10af4934e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:54.172047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:54.194854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 966/1900] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:54.203456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501c9d-20d7-43eb-a549-54a865aac667 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.203739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501c9d-20d7-43eb-a549-54a865aac667 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.204020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80501c9d-20d7-43eb-a549-54a865aac667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.243799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-80501c9d-20d7-43eb-a549-54a865aac667 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:54.245321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-80501c9d-20d7-43eb-a549-54a865aac667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:54.257461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 935/1901] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:54.261498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87a1b5-2dca-4b50-a815-f10af4934e4d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:54.272130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87a1b5-2dca-4b50-a815-f10af4934e4d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.278489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.279438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.279907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.283605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.284338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:54.285131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.287962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.312688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 967/1902] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:49:54.312889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80501c9d-20d7-43eb-a549-54a865aac667 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:54.323935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80501c9d-20d7-43eb-a549-54a865aac667 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.338536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f547-b2d8-4374-8c2d-987ad9d219f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.339265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f547-b2d8-4374-8c2d-987ad9d219f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.339549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f547-b2d8-4374-8c2d-987ad9d219f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.339825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766f547-b2d8-4374-8c2d-987ad9d219f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.340619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766f547-b2d8-4374-8c2d-987ad9d219f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.342655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766f547-b2d8-4374-8c2d-987ad9d219f4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.378967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 936/1903] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:54 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:49:54.384281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:54.395320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f855-ebb3-44f9-bda7-9354e132677e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.473061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1e26d-7926-4606-a932-2476fceadf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.474423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1e26d-7926-4606-a932-2476fceadf0e admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.474708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1e26d-7926-4606-a932-2476fceadf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.474986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1e26d-7926-4606-a932-2476fceadf0e admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.475636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1e26d-7926-4606-a932-2476fceadf0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.477732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1e26d-7926-4606-a932-2476fceadf0e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.504341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 968/1904] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:54 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:54.505399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f547-b2d8-4374-8c2d-987ad9d219f4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:54.516143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766f547-b2d8-4374-8c2d-987ad9d219f4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.521411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f9315-59fd-4d4e-b662-d412da4c3fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.522060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f9315-59fd-4d4e-b662-d412da4c3fea admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.522345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f9315-59fd-4d4e-b662-d412da4c3fea admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.522656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f9315-59fd-4d4e-b662-d412da4c3fea admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.523387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f9315-59fd-4d4e-b662-d412da4c3fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.524968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f9315-59fd-4d4e-b662-d412da4c3fea admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.526313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:54.535773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 937/1905] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:54.540541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1e26d-7926-4606-a932-2476fceadf0e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:54.550754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1e26d-7926-4606-a932-2476fceadf0e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.556019 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb13a7-ba19-425e-86b7-ecd1488f0515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.556658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb13a7-ba19-425e-86b7-ecd1488f0515 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.556946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb13a7-ba19-425e-86b7-ecd1488f0515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.557228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb13a7-ba19-425e-86b7-ecd1488f0515 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.557919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb13a7-ba19-425e-86b7-ecd1488f0515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.559595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb13a7-ba19-425e-86b7-ecd1488f0515 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.570788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 969/1906] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:54.574998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f9315-59fd-4d4e-b662-d412da4c3fea admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:54.584880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f9315-59fd-4d4e-b662-d412da4c3fea admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.589629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7948136-4bc2-4487-9a89-172b3e188161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.590295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948136-4bc2-4487-9a89-172b3e188161 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.590580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948136-4bc2-4487-9a89-172b3e188161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.590860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948136-4bc2-4487-9a89-172b3e188161 admin admin] PATH_INFO: `/v3/projects/fade6d583e2a44959fdfecf97b7d92b2/users/22a126ce71a4477d9cd62c34827b2302/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.605912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7948136-4bc2-4487-9a89-172b3e188161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fade6d583e2a44959fdfecf97b7d92b2, user_id=22a126ce71a4477d9cd62c34827b2302, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.608667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7948136-4bc2-4487-9a89-172b3e188161 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.623639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 938/1907] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:54 2022] PUT /identity/v3/projects/fade6d583e2a44959fdfecf97b7d92b2/users/22a126ce71a4477d9cd62c34827b2302/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:54.635221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433da650-f6a9-44ff-afdf-da3635ea394c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.635517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433da650-f6a9-44ff-afdf-da3635ea394c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.635798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433da650-f6a9-44ff-afdf-da3635ea394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.668489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-433da650-f6a9-44ff-afdf-da3635ea394c None None] MFA Rules not processed for user `22a126ce71a4477d9cd62c34827b2302`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:54.669894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-433da650-f6a9-44ff-afdf-da3635ea394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:54.758775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 970/1908] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:54.763716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7948136-4bc2-4487-9a89-172b3e188161 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:54.876605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433da650-f6a9-44ff-afdf-da3635ea394c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:54.881285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7948136-4bc2-4487-9a89-172b3e188161 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.882176 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-433da650-f6a9-44ff-afdf-da3635ea394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:54.886939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fba0d-4ea5-4876-a275-03f770f1ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.888127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fba0d-4ea5-4876-a275-03f770f1ec85 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.888610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fba0d-4ea5-4876-a275-03f770f1ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.889072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fba0d-4ea5-4876-a275-03f770f1ec85 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.889962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fba0d-4ea5-4876-a275-03f770f1ec85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.892221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fba0d-4ea5-4876-a275-03f770f1ec85 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.930839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433da650-f6a9-44ff-afdf-da3635ea394c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:54.939922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:54.941652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:54.941953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:54.942339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] PATH_INFO: `/v3/users/bc489f60f28b48109b6a13c3ff58d3e4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:54.943708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc489f60f28b48109b6a13c3ff58d3e4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:54.946031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:54.952999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 939/1909] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:54 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:54.959446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fba0d-4ea5-4876-a275-03f770f1ec85 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:55.002180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:55.046986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc489f60f28b48109b6a13c3ff58d3e4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:55.047701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc489f60f28b48109b6a13c3ff58d3e4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:55.048949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fba0d-4ea5-4876-a275-03f770f1ec85 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:55.056161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:55.057221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.058068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.058508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.059515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc489f60f28b48109b6a13c3ff58d3e4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:55.059807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:55.062495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc489f60f28b48109b6a13c3ff58d3e4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:55.062728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:55.083407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f938d8a6-168b-4595-87a3-478b0514b6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc489f60f28b48109b6a13c3ff58d3e4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:55.094794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 940/1910] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:54 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:55.099161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:55.101370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:55.111635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 971/1911] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:54 2022] DELETE /identity/v3/users/bc489f60f28b48109b6a13c3ff58d3e4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:55.113859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6c439-f2e9-4b00-8ce5-988d03ca8c5f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.114321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6c439-f2e9-4b00-8ce5-988d03ca8c5f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.114739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6c439-f2e9-4b00-8ce5-988d03ca8c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.118275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0250b7-e938-4a21-bd07-6d075f132d12 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:55.152712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0bc6c439-f2e9-4b00-8ce5-988d03ca8c5f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:55.154026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0bc6c439-f2e9-4b00-8ce5-988d03ca8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:55.196573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:55.224795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053320-1e10-4e0f-bcc6-d237a3fd3c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:55.225427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053320-1e10-4e0f-bcc6-d237a3fd3c09 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.225737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053320-1e10-4e0f-bcc6-d237a3fd3c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.226010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053320-1e10-4e0f-bcc6-d237a3fd3c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.226815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad053320-1e10-4e0f-bcc6-d237a3fd3c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:55.228276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad053320-1e10-4e0f-bcc6-d237a3fd3c09 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:55.244131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 941/1912] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:49:55.245127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053320-1e10-4e0f-bcc6-d237a3fd3c09 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:55.255199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 972/1913] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:55.263555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053320-1e10-4e0f-bcc6-d237a3fd3c09 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:55.265813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6c439-f2e9-4b00-8ce5-988d03ca8c5f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:55.268084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0bc6c439-f2e9-4b00-8ce5-988d03ca8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:55.269097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97b4af-7c61-4078-934c-00fb41e8c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:55.269834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97b4af-7c61-4078-934c-00fb41e8c960 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.270453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97b4af-7c61-4078-934c-00fb41e8c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.270733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97b4af-7c61-4078-934c-00fb41e8c960 admin admin] PATH_INFO: `/v3/projects/bd49ecf9bc3143d9b7e16af38d9c6eba/users/86cb9d2e372545e581acdca65971fd66/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.289238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97b4af-7c61-4078-934c-00fb41e8c960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd49ecf9bc3143d9b7e16af38d9c6eba, user_id=86cb9d2e372545e581acdca65971fd66, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:55.292924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97b4af-7c61-4078-934c-00fb41e8c960 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:55.320296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 942/1914] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:55 2022] PUT /identity/v3/projects/bd49ecf9bc3143d9b7e16af38d9c6eba/users/86cb9d2e372545e581acdca65971fd66/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:55.324552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97b4af-7c61-4078-934c-00fb41e8c960 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:55.340507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6c439-f2e9-4b00-8ce5-988d03ca8c5f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:55.413694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ad12a-7a35-4438-83a7-8c703b1219ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:55.415279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad12a-7a35-4438-83a7-8c703b1219ea service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.415279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad12a-7a35-4438-83a7-8c703b1219ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.415279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad12a-7a35-4438-83a7-8c703b1219ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.423862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97b4af-7c61-4078-934c-00fb41e8c960 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:55.429710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4cba9-826d-4448-8ef0-e840a88331d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:55.430313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4cba9-826d-4448-8ef0-e840a88331d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.430592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4cba9-826d-4448-8ef0-e840a88331d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.430917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4cba9-826d-4448-8ef0-e840a88331d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.431568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4cba9-826d-4448-8ef0-e840a88331d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:55.432512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ad12a-7a35-4438-83a7-8c703b1219ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:55.433561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4cba9-826d-4448-8ef0-e840a88331d2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:55.435514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ad12a-7a35-4438-83a7-8c703b1219ea service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:55.449785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 943/1915] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:49:55.452181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4cba9-826d-4448-8ef0-e840a88331d2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:55.453336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 973/1916] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:49:55.463963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4cba9-826d-4448-8ef0-e840a88331d2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:55.468894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:55.473114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.473351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.473701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] PATH_INFO: `/v3/projects/bd49ecf9bc3143d9b7e16af38d9c6eba/users/86cb9d2e372545e581acdca65971fd66/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.476402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd49ecf9bc3143d9b7e16af38d9c6eba, user_id=86cb9d2e372545e581acdca65971fd66, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:55.480785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:55.493230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 944/1917] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:55 2022] PUT /identity/v3/projects/bd49ecf9bc3143d9b7e16af38d9c6eba/users/86cb9d2e372545e581acdca65971fd66/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:55.504380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893cf65-fb56-4a4a-a8fc-6c05442100ae None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.505322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893cf65-fb56-4a4a-a8fc-6c05442100ae None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.505713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893cf65-fb56-4a4a-a8fc-6c05442100ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.542331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:55.548085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6893cf65-fb56-4a4a-a8fc-6c05442100ae None None] MFA Rules not processed for user `86cb9d2e372545e581acdca65971fd66`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:55.553212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6893cf65-fb56-4a4a-a8fc-6c05442100ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:55.674071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 974/1918] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:55.699336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:55.702306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:55.781691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a255b-3451-4e5f-9f06-f989d40aefae admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:55.787912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d758-4078-43e7-addd-23b019dc1f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:55.788544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d758-4078-43e7-addd-23b019dc1f2d service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:55.788825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d758-4078-43e7-addd-23b019dc1f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:55.789285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d758-4078-43e7-addd-23b019dc1f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:55.799563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206d758-4078-43e7-addd-23b019dc1f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:55.801014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206d758-4078-43e7-addd-23b019dc1f2d service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:55.811878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 945/1919] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:49:55.953011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893cf65-fb56-4a4a-a8fc-6c05442100ae None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:55.954732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6893cf65-fb56-4a4a-a8fc-6c05442100ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:56.039763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893cf65-fb56-4a4a-a8fc-6c05442100ae None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:56.048971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:56.049714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:56.049910 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:56.050196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] PATH_INFO: `/v3/projects/49e59673f7ef4f13a5ff6419f5f0ebf4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:56.051399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e59673f7ef4f13a5ff6419f5f0ebf4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:56.056738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:56.123551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e59673f7ef4f13a5ff6419f5f0ebf4', 'request_id': 'req-2128ed42-f78d-4eb0-8aad-94c4cef5921f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.133346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e59673f7ef4f13a5ff6419f5f0ebf4', 'request_id': 'req-2128ed42-f78d-4eb0-8aad-94c4cef5921f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.141977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e59673f7ef4f13a5ff6419f5f0ebf4', 'request_id': 'req-2128ed42-f78d-4eb0-8aad-94c4cef5921f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.159604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] The token cache is being invalidate because project 49e59673f7ef4f13a5ff6419f5f0ebf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:56.159905 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.160613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.162866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 975/1920] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:55 2022] DELETE /identity/v3/projects/49e59673f7ef4f13a5ff6419f5f0ebf4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:56.168729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d758-4078-43e7-addd-23b019dc1f2d service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:56.183112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d758-4078-43e7-addd-23b019dc1f2d service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:56.232594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:56.256890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:56.257528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:56.257788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:56.258062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] PATH_INFO: `/v3/users/109151a90dd74b3d8113729e2329c9b2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:56.259217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109151a90dd74b3d8113729e2329c9b2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:56.261186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:56.322358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109151a90dd74b3d8113729e2329c9b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.323037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109151a90dd74b3d8113729e2329c9b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.338697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109151a90dd74b3d8113729e2329c9b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.339344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109151a90dd74b3d8113729e2329c9b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.347479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109151a90dd74b3d8113729e2329c9b2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:56.383515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 946/1921] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:56 2022] DELETE /identity/v3/users/109151a90dd74b3d8113729e2329c9b2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:56.759977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:56.761338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:56.778572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128ed42-f78d-4eb0-8aad-94c4cef5921f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:56.810349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:56.884003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:56.885610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:56.892598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:56.893297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:56.893578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:56.893886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] PATH_INFO: `/v3/users/22a126ce71a4477d9cd62c34827b2302` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:56.896284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a126ce71a4477d9cd62c34827b2302)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:56.898765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:56.951859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ad2f-ac36-424a-afb9-00a53b38d165 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:56.960163 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:56.963454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:56.965766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:56.966157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] PATH_INFO: `/v3/projects/055b900e6fc6474fa25d6d6e4c0da612` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:56.967822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055b900e6fc6474fa25d6d6e4c0da612)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:56.970071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:57.001358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a126ce71a4477d9cd62c34827b2302'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.002082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a126ce71a4477d9cd62c34827b2302'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.010960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a126ce71a4477d9cd62c34827b2302'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.012160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a126ce71a4477d9cd62c34827b2302'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.030022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8ad672d2-ae5e-43d1-9c5c-6d3cde603062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a126ce71a4477d9cd62c34827b2302'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.036402 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055b900e6fc6474fa25d6d6e4c0da612', 'request_id': 'req-31d615bf-c495-4442-ad6f-3cee535fb494'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.045984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055b900e6fc6474fa25d6d6e4c0da612', 'request_id': 'req-31d615bf-c495-4442-ad6f-3cee535fb494'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.056113 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055b900e6fc6474fa25d6d6e4c0da612', 'request_id': 'req-31d615bf-c495-4442-ad6f-3cee535fb494'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.059021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 976/1922] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:56 2022] DELETE /identity/v3/users/22a126ce71a4477d9cd62c34827b2302 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:57.064194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cdc9-3cf5-41fb-97fa-06334b4c9edd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:57.064955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cdc9-3cf5-41fb-97fa-06334b4c9edd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:57.065861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cdc9-3cf5-41fb-97fa-06334b4c9edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:57.086513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] The token cache is being invalidate because project 055b900e6fc6474fa25d6d6e4c0da612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:57.086805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.087773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.099914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 947/1923] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:56 2022] DELETE /identity/v3/projects/055b900e6fc6474fa25d6d6e4c0da612 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:57.100951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:57.102737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:57.105363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7c01cdc9-3cf5-41fb-97fa-06334b4c9edd None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:57.107716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7c01cdc9-3cf5-41fb-97fa-06334b4c9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:57.174095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:57.205895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d615bf-c495-4442-ad6f-3cee535fb494 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:57.206814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 977/1924] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:57.212131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:57.212776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:57.213070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:57.213351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] PATH_INFO: `/v3/users/3e0bde6c83034dd280506963fbd43468` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:57.214573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0bde6c83034dd280506963fbd43468)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:57.217215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:57.220709 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cdc9-3cf5-41fb-97fa-06334b4c9edd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:57.222713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7c01cdc9-3cf5-41fb-97fa-06334b4c9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:57.286300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0bde6c83034dd280506963fbd43468'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.287003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0bde6c83034dd280506963fbd43468'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.295014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0bde6c83034dd280506963fbd43468'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.295837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0bde6c83034dd280506963fbd43468'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.298552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:57.304118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cdc9-3cf5-41fb-97fa-06334b4c9edd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:57.305270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0bde6c83034dd280506963fbd43468'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:57.312202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:57.312869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:57.313273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:57.314966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:57.317934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:57.332577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 948/1925] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:57 2022] DELETE /identity/v3/users/3e0bde6c83034dd280506963fbd43468 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:57.333291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:57.334939 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:57.345901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 978/1926] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:49:58.511696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:58.513395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:58.536268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:58.538406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:58.552684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2033285-1f60-4bf6-bf62-7c1d4d488aab service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:58.615485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf18c5-a2b8-46f6-b91f-b6dff76397ec admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:58.622580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:58.623429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:58.623897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:58.624263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] PATH_INFO: `/v3/projects/7c4b70a9bc1f4465abab3e122578fe63` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:58.625931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4b70a9bc1f4465abab3e122578fe63)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:58.628679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:58.629280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:58.630295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:58.630429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:58.630582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] PATH_INFO: `/v3/projects/fade6d583e2a44959fdfecf97b7d92b2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:58.631842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fade6d583e2a44959fdfecf97b7d92b2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:58.634502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:58.686698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4b70a9bc1f4465abab3e122578fe63', 'request_id': 'req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.693200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fade6d583e2a44959fdfecf97b7d92b2', 'request_id': 'req-fb4a3754-c164-47e8-9c3e-e641a06411d3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.693385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4b70a9bc1f4465abab3e122578fe63', 'request_id': 'req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.700000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fade6d583e2a44959fdfecf97b7d92b2', 'request_id': 'req-fb4a3754-c164-47e8-9c3e-e641a06411d3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.703463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4b70a9bc1f4465abab3e122578fe63', 'request_id': 'req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.706024 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:58.706982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fade6d583e2a44959fdfecf97b7d92b2', 'request_id': 'req-fb4a3754-c164-47e8-9c3e-e641a06411d3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.718743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] The token cache is being invalidate because project 7c4b70a9bc1f4465abab3e122578fe63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:58.719286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.720292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1e162f3b-edf6-4ea5-ae83-1e1c79b8d247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.722144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 949/1927] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:58 2022] DELETE /identity/v3/projects/7c4b70a9bc1f4465abab3e122578fe63 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:58.724023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] The token cache is being invalidate because project fade6d583e2a44959fdfecf97b7d92b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:49:58.724326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.725169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.726880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 979/1928] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:58 2022] DELETE /identity/v3/projects/fade6d583e2a44959fdfecf97b7d92b2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:58.728256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aef2b-22e1-49c9-b7c1-0248c4f17854 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:58.728707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aef2b-22e1-49c9-b7c1-0248c4f17854 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:58.728992 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aef2b-22e1-49c9-b7c1-0248c4f17854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:58.730639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:58.732126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:58.750837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f88aef2b-22e1-49c9-b7c1-0248c4f17854 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:58.752159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f88aef2b-22e1-49c9-b7c1-0248c4f17854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:58.804583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a3754-c164-47e8-9c3e-e641a06411d3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:58.809365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:58.810044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:58.810745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:58.810745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] PATH_INFO: `/v3/users/86cb9d2e372545e581acdca65971fd66` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:58.812050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86cb9d2e372545e581acdca65971fd66)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:58.814552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:58.824916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 950/1929] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:58.834100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379522c-1a55-42d8-b3f2-080f1c25485a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:58.834316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379522c-1a55-42d8-b3f2-080f1c25485a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:58.834595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379522c-1a55-42d8-b3f2-080f1c25485a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:58.844869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:58.857141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2379522c-1a55-42d8-b3f2-080f1c25485a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:58.858829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2379522c-1a55-42d8-b3f2-080f1c25485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:58.870555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 951/1930] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:49:58.873227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379522c-1a55-42d8-b3f2-080f1c25485a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:58.876128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86cb9d2e372545e581acdca65971fd66'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.876810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86cb9d2e372545e581acdca65971fd66'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.883854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379522c-1a55-42d8-b3f2-080f1c25485a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:58.885327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86cb9d2e372545e581acdca65971fd66'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.886050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86cb9d2e372545e581acdca65971fd66'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.890772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:58.891532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:58.891972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:58.892342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:58.893090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:49:58.893636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:58.895531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:58.905671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86cb9d2e372545e581acdca65971fd66'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:58.907958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 952/1931] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:49:58.912771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:58.914967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:58.925797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 980/1932] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:58 2022] DELETE /identity/v3/users/86cb9d2e372545e581acdca65971fd66 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:49:58.930729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2504d8-e0fe-4794-8ec9-a048e20d7afc admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.007204 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8678e1-eac2-4706-a3d5-aa82a5941890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.007837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8678e1-eac2-4706-a3d5-aa82a5941890 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.008120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8678e1-eac2-4706-a3d5-aa82a5941890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.008423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8678e1-eac2-4706-a3d5-aa82a5941890 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.009035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8678e1-eac2-4706-a3d5-aa82a5941890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.011163 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8678e1-eac2-4706-a3d5-aa82a5941890 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.054240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 953/1933] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:49:58 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:59.069911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:59.092094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084e83a-f330-4c92-a00f-11a5381b277b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.190236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79e8b-52db-49ba-86de-6a3468083f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.191157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e8b-52db-49ba-86de-6a3468083f1f admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.191775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e8b-52db-49ba-86de-6a3468083f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.192745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79e8b-52db-49ba-86de-6a3468083f1f admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.193624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd79e8b-52db-49ba-86de-6a3468083f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.195760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd79e8b-52db-49ba-86de-6a3468083f1f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.248446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 981/1934] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:49:59 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:49:59.251034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8678e1-eac2-4706-a3d5-aa82a5941890 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:59.276679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8678e1-eac2-4706-a3d5-aa82a5941890 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.295125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdcd3c-0b83-4494-a83f-7cbd1770a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.295762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdcd3c-0b83-4494-a83f-7cbd1770a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.296048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdcd3c-0b83-4494-a83f-7cbd1770a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.296325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdcd3c-0b83-4494-a83f-7cbd1770a2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.296975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdcd3c-0b83-4494-a83f-7cbd1770a2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.298635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdcd3c-0b83-4494-a83f-7cbd1770a2ee admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.324388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 954/1935] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:59.343472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79e8b-52db-49ba-86de-6a3468083f1f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:59.356789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79e8b-52db-49ba-86de-6a3468083f1f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.362329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.363695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.364643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.364993 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.365754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.367686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.385136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 982/1936] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:49:59.389010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdcd3c-0b83-4494-a83f-7cbd1770a2ee admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:59.402507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdcd3c-0b83-4494-a83f-7cbd1770a2ee admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.411796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:59.422361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:59.428375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60181ee-7ca5-4110-97d6-b59bcfcee909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.429151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60181ee-7ca5-4110-97d6-b59bcfcee909 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.429424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60181ee-7ca5-4110-97d6-b59bcfcee909 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.431573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60181ee-7ca5-4110-97d6-b59bcfcee909 admin admin] PATH_INFO: `/v3/projects/21c7c35072a44e54bf1d5b831cf56a91/users/5144d30d724b419eae2b8992235bc573/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.449146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067089f-dd4a-4b2a-92c2-1568c2322d98 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.456612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.458232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.458651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.459066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] PATH_INFO: `/v3/users/15358554fdf84238b830387571e4736a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.459278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60181ee-7ca5-4110-97d6-b59bcfcee909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c7c35072a44e54bf1d5b831cf56a91, user_id=5144d30d724b419eae2b8992235bc573, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.461046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=15358554fdf84238b830387571e4736a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.462793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60181ee-7ca5-4110-97d6-b59bcfcee909 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.463267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.484763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 955/1937] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:49:59 2022] PUT /identity/v3/projects/21c7c35072a44e54bf1d5b831cf56a91/users/5144d30d724b419eae2b8992235bc573/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:59.493181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b8b1a-00fd-49f5-bf38-e925867c54f3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.493748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b8b1a-00fd-49f5-bf38-e925867c54f3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.494032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b8b1a-00fd-49f5-bf38-e925867c54f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.539987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ea3b8b1a-00fd-49f5-bf38-e925867c54f3 None None] MFA Rules not processed for user `5144d30d724b419eae2b8992235bc573`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:59.542207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ea3b8b1a-00fd-49f5-bf38-e925867c54f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:59.559430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:59.568111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15358554fdf84238b830387571e4736a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:59.569541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15358554fdf84238b830387571e4736a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:59.593511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15358554fdf84238b830387571e4736a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:59.593511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15358554fdf84238b830387571e4736a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:59.603370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42cbdbc3-cfc0-4be2-a78e-e37f74f1e8cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15358554fdf84238b830387571e4736a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:49:59.605822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:49:59.653091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 983/1938] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:49:59 2022] DELETE /identity/v3/users/15358554fdf84238b830387571e4736a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:49:59.653091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f877-884f-4340-b1bb-f7e66e3d5c08 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.653091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f877-884f-4340-b1bb-f7e66e3d5c08 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.653091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f877-884f-4340-b1bb-f7e66e3d5c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.667142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 956/1939] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:59.679741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b8b1a-00fd-49f5-bf38-e925867c54f3 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:59.681656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ea3b8b1a-00fd-49f5-bf38-e925867c54f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:59.682664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6a72f877-884f-4340-b1bb-f7e66e3d5c08 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:49:59.683976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6a72f877-884f-4340-b1bb-f7e66e3d5c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:59.753185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b8b1a-00fd-49f5-bf38-e925867c54f3 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.763131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 984/1940] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:49:59.769672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72f877-884f-4340-b1bb-f7e66e3d5c08 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:59.771613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6a72f877-884f-4340-b1bb-f7e66e3d5c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:59.828735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183d9da-f30c-437c-b7ec-06e02728d2ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.829318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d9da-f30c-437c-b7ec-06e02728d2ba service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.829613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d9da-f30c-437c-b7ec-06e02728d2ba service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.829899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183d9da-f30c-437c-b7ec-06e02728d2ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.851858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72f877-884f-4340-b1bb-f7e66e3d5c08 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.858973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.859617 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.859915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.860179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.872342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.874264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.888329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 985/1941] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:49:59.889110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:49:59.890231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:49:59.909264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7a0f4-09af-4279-aca8-ccf04a56b887 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:49:59.925057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183d9da-f30c-437c-b7ec-06e02728d2ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.928493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183d9da-f30c-437c-b7ec-06e02728d2ba service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.930264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:49:59.930922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:49:59.931204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:49:59.931700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] PATH_INFO: `/v3/projects/bd49ecf9bc3143d9b7e16af38d9c6eba` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:49:59.933351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd49ecf9bc3143d9b7e16af38d9c6eba)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:49:59.935882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:49:59.948643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 957/1942] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:49:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:00.036356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd49ecf9bc3143d9b7e16af38d9c6eba', 'request_id': 'req-9eb865be-8550-4a33-b7b3-0297ec22ae00'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.045248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd49ecf9bc3143d9b7e16af38d9c6eba', 'request_id': 'req-9eb865be-8550-4a33-b7b3-0297ec22ae00'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.057673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd49ecf9bc3143d9b7e16af38d9c6eba', 'request_id': 'req-9eb865be-8550-4a33-b7b3-0297ec22ae00'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.076317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] The token cache is being invalidate because project bd49ecf9bc3143d9b7e16af38d9c6eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:00.076719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.077724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9eb865be-8550-4a33-b7b3-0297ec22ae00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.079799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 986/1943] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:49:59 2022] DELETE /identity/v3/projects/bd49ecf9bc3143d9b7e16af38d9c6eba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:00.093907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25025b3-8182-44f8-9fe5-6dad10893c6b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:00.095433 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25025b3-8182-44f8-9fe5-6dad10893c6b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:00.096242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25025b3-8182-44f8-9fe5-6dad10893c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:00.133764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f25025b3-8182-44f8-9fe5-6dad10893c6b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:00.135132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f25025b3-8182-44f8-9fe5-6dad10893c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:00.166394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:00.241873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 958/1944] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:00.250270 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c4d8d-7037-4ea0-968f-9a0c32edf311 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:00.250928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c4d8d-7037-4ea0-968f-9a0c32edf311 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:00.251391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c4d8d-7037-4ea0-968f-9a0c32edf311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:00.287363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-af8c4d8d-7037-4ea0-968f-9a0c32edf311 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:00.288898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-af8c4d8d-7037-4ea0-968f-9a0c32edf311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:00.305644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 987/1945] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:00.307256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25025b3-8182-44f8-9fe5-6dad10893c6b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:00.318738 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25025b3-8182-44f8-9fe5-6dad10893c6b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:00.324634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:00.325265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:00.325547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:00.326048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:00.327847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:00.328134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:00.330634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:00.349460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 959/1946] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:50:00.353113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c4d8d-7037-4ea0-968f-9a0c32edf311 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:00.379080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c4d8d-7037-4ea0-968f-9a0c32edf311 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:00.404896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:00.407664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:00.420740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673cff-7f5e-42ea-b5a3-53fb6ca79ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:00.422038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673cff-7f5e-42ea-b5a3-53fb6ca79ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:00.422141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673cff-7f5e-42ea-b5a3-53fb6ca79ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:00.422529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673cff-7f5e-42ea-b5a3-53fb6ca79ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:00.432369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673cff-7f5e-42ea-b5a3-53fb6ca79ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:00.440375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673cff-7f5e-42ea-b5a3-53fb6ca79ad9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:00.462642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb5c8d-9dc9-4e4d-b769-2050121a0795 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:00.481146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:00.487430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:00.491188 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:00.491662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:00.492207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] PATH_INFO: `/v3/projects/a55d93cc3dbd497485aae3ad92d33291` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:00.497512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55d93cc3dbd497485aae3ad92d33291)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:00.501002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:00.550305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 988/1947] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:00 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:00.554802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673cff-7f5e-42ea-b5a3-53fb6ca79ad9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:00.725059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55d93cc3dbd497485aae3ad92d33291', 'request_id': 'req-0066f932-102f-4891-acd2-3f1dbe0d08bd'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.753850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55d93cc3dbd497485aae3ad92d33291', 'request_id': 'req-0066f932-102f-4891-acd2-3f1dbe0d08bd'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.781747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55d93cc3dbd497485aae3ad92d33291', 'request_id': 'req-0066f932-102f-4891-acd2-3f1dbe0d08bd'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.787677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673cff-7f5e-42ea-b5a3-53fb6ca79ad9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:00.797684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] The token cache is being invalidate because project a55d93cc3dbd497485aae3ad92d33291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:00.798299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.799467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0066f932-102f-4891-acd2-3f1dbe0d08bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:00.801914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 960/1948] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:00 2022] DELETE /identity/v3/projects/a55d93cc3dbd497485aae3ad92d33291 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:00.806872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf7541-ed98-4705-93e8-bed12210934d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:00.807584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf7541-ed98-4705-93e8-bed12210934d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:00.808068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf7541-ed98-4705-93e8-bed12210934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:00.841298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-97bf7541-ed98-4705-93e8-bed12210934d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:00.846450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-97bf7541-ed98-4705-93e8-bed12210934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:00.936963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:00.937746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:00.938102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:00.938449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:00.939537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:00.945164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.000807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 989/1949] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:00 2022] POST /identity/v3/users => generated 292 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:01.008394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.009955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 961/1950] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:01.015165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:01.018022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613222-427c-491e-b8a2-ac04547077ab None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.018331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613222-427c-491e-b8a2-ac04547077ab None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.018616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613222-427c-491e-b8a2-ac04547077ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.048882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac79c7-08af-4be4-a8e0-4ad2929f14bb admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.068292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524d3fb-e200-48fd-b11a-36035f797ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.069189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d3fb-e200-48fd-b11a-36035f797ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.069360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d3fb-e200-48fd-b11a-36035f797ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.069663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d3fb-e200-48fd-b11a-36035f797ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.070444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524d3fb-e200-48fd-b11a-36035f797ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.072148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524d3fb-e200-48fd-b11a-36035f797ac2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.083482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-20613222-427c-491e-b8a2-ac04547077ab None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:01.084766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-20613222-427c-491e-b8a2-ac04547077ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:01.093741 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 990/1951] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:01.096443 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524d3fb-e200-48fd-b11a-36035f797ac2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.110744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 962/1952] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:01.117558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613222-427c-491e-b8a2-ac04547077ab None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.119347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524d3fb-e200-48fd-b11a-36035f797ac2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.125283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab57951-bd34-4962-96ef-a044e2226d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.126164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab57951-bd34-4962-96ef-a044e2226d52 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.126662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab57951-bd34-4962-96ef-a044e2226d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.127161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab57951-bd34-4962-96ef-a044e2226d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.127979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab57951-bd34-4962-96ef-a044e2226d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.131151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab57951-bd34-4962-96ef-a044e2226d52 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.143218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613222-427c-491e-b8a2-ac04547077ab None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.147217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 991/1953] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:01.153591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab57951-bd34-4962-96ef-a044e2226d52 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.163274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.163699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.163990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.164753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.164971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:01.165285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.167002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.186615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab57951-bd34-4962-96ef-a044e2226d52 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.187760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 963/1954] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:01.191867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.201714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036d8c4-7e9b-4883-8723-01be159dd5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.202502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036d8c4-7e9b-4883-8723-01be159dd5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.202880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036d8c4-7e9b-4883-8723-01be159dd5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.203256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036d8c4-7e9b-4883-8723-01be159dd5a5 admin admin] PATH_INFO: `/v3/projects/512c23fc6941435da204c836e028c95d/users/3ffdb2b6c5744cdab47ef27a28e56f82/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.213904 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287692f6-c619-4bee-9ba4-eb356190e4a8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.227698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d319f-54a2-4691-bc96-8226d91e4e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.229441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d319f-54a2-4691-bc96-8226d91e4e1c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.230518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d319f-54a2-4691-bc96-8226d91e4e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.231810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d319f-54a2-4691-bc96-8226d91e4e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.232565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d319f-54a2-4691-bc96-8226d91e4e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.236266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d319f-54a2-4691-bc96-8226d91e4e1c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.241572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036d8c4-7e9b-4883-8723-01be159dd5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512c23fc6941435da204c836e028c95d, user_id=3ffdb2b6c5744cdab47ef27a28e56f82, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.244442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036d8c4-7e9b-4883-8723-01be159dd5a5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.284389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 992/1955] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:01 2022] PUT /identity/v3/projects/512c23fc6941435da204c836e028c95d/users/3ffdb2b6c5744cdab47ef27a28e56f82/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:01.284623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:01.289455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66d609-da98-4ca5-b331-bfa4c7b44227 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.290050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66d609-da98-4ca5-b331-bfa4c7b44227 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.290747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66d609-da98-4ca5-b331-bfa4c7b44227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.311909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 964/1956] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:01 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:01.315717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d319f-54a2-4691-bc96-8226d91e4e1c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.338411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9c66d609-da98-4ca5-b331-bfa4c7b44227 None None] MFA Rules not processed for user `3ffdb2b6c5744cdab47ef27a28e56f82`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:01.342532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9c66d609-da98-4ca5-b331-bfa4c7b44227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:01.411637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:01.450092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d319f-54a2-4691-bc96-8226d91e4e1c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.456156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f35a-704b-4a17-8df6-96984c8efa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.457347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f35a-704b-4a17-8df6-96984c8efa44 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.457853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f35a-704b-4a17-8df6-96984c8efa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.458292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f35a-704b-4a17-8df6-96984c8efa44 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.459350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10f35a-704b-4a17-8df6-96984c8efa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.461907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10f35a-704b-4a17-8df6-96984c8efa44 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.463975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 993/1957] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:01.464955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66d609-da98-4ca5-b331-bfa4c7b44227 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.466399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9c66d609-da98-4ca5-b331-bfa4c7b44227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:01.485505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66d609-da98-4ca5-b331-bfa4c7b44227 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.491724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.492420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 965/1958] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:01 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:01.492663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.493507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.494035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] PATH_INFO: `/v3/users/384e9a6d68424232a4ec8fc8a73bbc48` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.495349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] RBAC: Authorizing `identity:delete_user(user_id=384e9a6d68424232a4ec8fc8a73bbc48)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.496674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f35a-704b-4a17-8df6-96984c8efa44 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.497536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.510012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f35a-704b-4a17-8df6-96984c8efa44 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.530434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63bbd-09da-44fd-a709-b18306c0d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.531234 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63bbd-09da-44fd-a709-b18306c0d129 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.531599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63bbd-09da-44fd-a709-b18306c0d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.531970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63bbd-09da-44fd-a709-b18306c0d129 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.532979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa63bbd-09da-44fd-a709-b18306c0d129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.536613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa63bbd-09da-44fd-a709-b18306c0d129 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.586998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384e9a6d68424232a4ec8fc8a73bbc48'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:01.588624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384e9a6d68424232a4ec8fc8a73bbc48'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:01.602784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 966/1959] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:01 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:01.604870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63bbd-09da-44fd-a709-b18306c0d129 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.608281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384e9a6d68424232a4ec8fc8a73bbc48'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:01.609939 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384e9a6d68424232a4ec8fc8a73bbc48'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:01.647086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384e9a6d68424232a4ec8fc8a73bbc48'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:01.678092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 994/1960] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:01 2022] DELETE /identity/v3/users/384e9a6d68424232a4ec8fc8a73bbc48 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:01.679146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:01.680826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:01.734922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63bbd-09da-44fd-a709-b18306c0d129 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.852827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79413dd1-da9c-491a-9b8e-a4fbf64d1bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.854316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79413dd1-da9c-491a-9b8e-a4fbf64d1bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.854694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79413dd1-da9c-491a-9b8e-a4fbf64d1bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.856899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79413dd1-da9c-491a-9b8e-a4fbf64d1bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.858729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79413dd1-da9c-491a-9b8e-a4fbf64d1bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.862495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79413dd1-da9c-491a-9b8e-a4fbf64d1bf1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:01.890878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 967/1961] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:01.892971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535731b-b3b8-4782-9e0f-71cc9514c393 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.893386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535731b-b3b8-4782-9e0f-71cc9514c393 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.893787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535731b-b3b8-4782-9e0f-71cc9514c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.955471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:01.958732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73991d6e-f693-49fb-b1f9-fe1f97cb529c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:01.978311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492332-3a7c-4ea6-b6d4-61367110b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:01.979013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492332-3a7c-4ea6-b6d4-61367110b2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:01.979302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492332-3a7c-4ea6-b6d4-61367110b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:01.979580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41492332-3a7c-4ea6-b6d4-61367110b2f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:01.983788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41492332-3a7c-4ea6-b6d4-61367110b2f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:01.986337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b535731b-b3b8-4782-9e0f-71cc9514c393 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:01.990178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b535731b-b3b8-4782-9e0f-71cc9514c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:01.991191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41492332-3a7c-4ea6-b6d4-61367110b2f5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.019422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 968/1962] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:02.021588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535731b-b3b8-4782-9e0f-71cc9514c393 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.023326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b535731b-b3b8-4782-9e0f-71cc9514c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:02.042315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535731b-b3b8-4782-9e0f-71cc9514c393 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.049797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.050932 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.051534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.052253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.053766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.056510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.074388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 969/1963] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:02.075906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.078786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:02.087563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 995/1964] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:01 2022] POST /identity/v3/users => generated 297 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:02.088759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492332-3a7c-4ea6-b6d4-61367110b2f5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.111128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41492332-3a7c-4ea6-b6d4-61367110b2f5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.126783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee4d7a-0f7a-43ab-8315-5d53595b3d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.127473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4d7a-0f7a-43ab-8315-5d53595b3d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.127913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4d7a-0f7a-43ab-8315-5d53595b3d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.128196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4d7a-0f7a-43ab-8315-5d53595b3d9e admin admin] PATH_INFO: `/v3/projects/faf6aa9ec59647d1b5d348ef31382e3b/users/7d2762bf55b041468f270e91a5ddb973/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.196528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee4d7a-0f7a-43ab-8315-5d53595b3d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf6aa9ec59647d1b5d348ef31382e3b, user_id=7d2762bf55b041468f270e91a5ddb973, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.215592 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee4d7a-0f7a-43ab-8315-5d53595b3d9e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.216448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441e32f-edea-4cfa-93a2-900b736f8d7d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.227643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8789f9-1d51-41aa-9855-bdae2e079408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.228629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8789f9-1d51-41aa-9855-bdae2e079408 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.228986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8789f9-1d51-41aa-9855-bdae2e079408 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.229263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8789f9-1d51-41aa-9855-bdae2e079408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.246974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 996/1965] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:02 2022] PUT /identity/v3/projects/faf6aa9ec59647d1b5d348ef31382e3b/users/7d2762bf55b041468f270e91a5ddb973/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:02.252765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8789f9-1d51-41aa-9855-bdae2e079408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.256704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8789f9-1d51-41aa-9855-bdae2e079408 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.257448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee4d7a-0f7a-43ab-8315-5d53595b3d9e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.271664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:02.287749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 970/1966] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:02.291321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b28ed1-f9f7-468a-99eb-d4121d4b1dd8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.292811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b28ed1-f9f7-468a-99eb-d4121d4b1dd8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.293108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b28ed1-f9f7-468a-99eb-d4121d4b1dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.354856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f4b28ed1-f9f7-468a-99eb-d4121d4b1dd8 None None] MFA Rules not processed for user `7d2762bf55b041468f270e91a5ddb973`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:02.356701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f4b28ed1-f9f7-468a-99eb-d4121d4b1dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:02.399648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee4d7a-0f7a-43ab-8315-5d53595b3d9e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.410655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc73576-b027-4901-8e1c-0bd7634595f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.412027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73576-b027-4901-8e1c-0bd7634595f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.412677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73576-b027-4901-8e1c-0bd7634595f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.413404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73576-b027-4901-8e1c-0bd7634595f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.414318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc73576-b027-4901-8e1c-0bd7634595f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.416335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc73576-b027-4901-8e1c-0bd7634595f2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.463398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 971/1967] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:02.463594 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 997/1968] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:02.463806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b28ed1-f9f7-468a-99eb-d4121d4b1dd8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.464060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc73576-b027-4901-8e1c-0bd7634595f2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.475458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc73576-b027-4901-8e1c-0bd7634595f2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.478491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b28ed1-f9f7-468a-99eb-d4121d4b1dd8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.481554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad081549-fa42-46e9-b5d7-0673afbb8d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.482435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad081549-fa42-46e9-b5d7-0673afbb8d3d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.482778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad081549-fa42-46e9-b5d7-0673afbb8d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.483142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad081549-fa42-46e9-b5d7-0673afbb8d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.484086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad081549-fa42-46e9-b5d7-0673afbb8d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.484722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dd528-fb44-4da6-b0a7-25d7f387eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.485491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dd528-fb44-4da6-b0a7-25d7f387eae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.485908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dd528-fb44-4da6-b0a7-25d7f387eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.486247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dd528-fb44-4da6-b0a7-25d7f387eae5 admin admin] PATH_INFO: `/v3/projects/d2c55d6ca6ec4dc98da49930007e0e91/users/82b6d87324bd4d2f908e7cfbc04ada8b/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.487087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad081549-fa42-46e9-b5d7-0673afbb8d3d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.509008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dd528-fb44-4da6-b0a7-25d7f387eae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c55d6ca6ec4dc98da49930007e0e91, user_id=82b6d87324bd4d2f908e7cfbc04ada8b, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.513797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dd528-fb44-4da6-b0a7-25d7f387eae5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.529721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 998/1969] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:02 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:02.533037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad081549-fa42-46e9-b5d7-0673afbb8d3d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.546672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 972/1970] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:02 2022] PUT /identity/v3/projects/d2c55d6ca6ec4dc98da49930007e0e91/users/82b6d87324bd4d2f908e7cfbc04ada8b/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:02.549141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dd528-fb44-4da6-b0a7-25d7f387eae5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.667415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:02.674774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dd528-fb44-4da6-b0a7-25d7f387eae5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.741992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad081549-fa42-46e9-b5d7-0673afbb8d3d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.748054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826818-f6b9-4124-b8ff-736059d92d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.749366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826818-f6b9-4124-b8ff-736059d92d10 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.750052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826818-f6b9-4124-b8ff-736059d92d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.750545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826818-f6b9-4124-b8ff-736059d92d10 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.751521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42826818-f6b9-4124-b8ff-736059d92d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.754303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42826818-f6b9-4124-b8ff-736059d92d10 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.762092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c63aa-6d07-42f9-9ca6-1c682cbe0daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.762710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c63aa-6d07-42f9-9ca6-1c682cbe0daa admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.762994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c63aa-6d07-42f9-9ca6-1c682cbe0daa admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.763265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c63aa-6d07-42f9-9ca6-1c682cbe0daa admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.763922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c63aa-6d07-42f9-9ca6-1c682cbe0daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.766146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c63aa-6d07-42f9-9ca6-1c682cbe0daa admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.785072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 973/1971] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:02.785588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 999/1972] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:02 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:02.790008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c63aa-6d07-42f9-9ca6-1c682cbe0daa admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.790420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826818-f6b9-4124-b8ff-736059d92d10 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.802360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826818-f6b9-4124-b8ff-736059d92d10 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.806041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c63aa-6d07-42f9-9ca6-1c682cbe0daa admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.807306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7443ad-15e5-47b6-97da-73ed88a4d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.807944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7443ad-15e5-47b6-97da-73ed88a4d284 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.808220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7443ad-15e5-47b6-97da-73ed88a4d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.808490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7443ad-15e5-47b6-97da-73ed88a4d284 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.809152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7443ad-15e5-47b6-97da-73ed88a4d284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.811306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7443ad-15e5-47b6-97da-73ed88a4d284 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.813269 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3a9bf-c0bd-48de-893d-5f8420cd1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.814215 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a9bf-c0bd-48de-893d-5f8420cd1bee admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.814588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a9bf-c0bd-48de-893d-5f8420cd1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.814940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3a9bf-c0bd-48de-893d-5f8420cd1bee admin admin] PATH_INFO: `/v3/projects/d2c55d6ca6ec4dc98da49930007e0e91/users/82b6d87324bd4d2f908e7cfbc04ada8b/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.817317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3a9bf-c0bd-48de-893d-5f8420cd1bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c55d6ca6ec4dc98da49930007e0e91, user_id=82b6d87324bd4d2f908e7cfbc04ada8b, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.820459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3a9bf-c0bd-48de-893d-5f8420cd1bee admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.826581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1000/1973] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:02.828137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7443ad-15e5-47b6-97da-73ed88a4d284 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.841723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 974/1974] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:02 2022] PUT /identity/v3/projects/d2c55d6ca6ec4dc98da49930007e0e91/users/82b6d87324bd4d2f908e7cfbc04ada8b/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:02.841943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7443ad-15e5-47b6-97da-73ed88a4d284 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.848711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c866382-3779-42de-ae43-b219bcb090ec None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.849274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c866382-3779-42de-ae43-b219bcb090ec None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.849801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c866382-3779-42de-ae43-b219bcb090ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.888721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2c866382-3779-42de-ae43-b219bcb090ec None None] MFA Rules not processed for user `82b6d87324bd4d2f908e7cfbc04ada8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:02.890195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2c866382-3779-42de-ae43-b219bcb090ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:02.917119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262e655-cb7e-44fc-be2b-761bff8ebeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.918153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262e655-cb7e-44fc-be2b-761bff8ebeed admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.919427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262e655-cb7e-44fc-be2b-761bff8ebeed admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.919903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262e655-cb7e-44fc-be2b-761bff8ebeed admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:02.920899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262e655-cb7e-44fc-be2b-761bff8ebeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:02.922917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262e655-cb7e-44fc-be2b-761bff8ebeed admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:02.924899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:02.945283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1001/1975] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:02.950066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262e655-cb7e-44fc-be2b-761bff8ebeed admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:02.971620 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262e655-cb7e-44fc-be2b-761bff8ebeed admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:02.980811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:02.982084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:02.983255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:02.983864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] PATH_INFO: `/v3/projects/b75560bb485b414fb562bd08f46990ed/users/d951d871dd314276969ad2fcd2e2a9df/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:03.022432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 975/1976] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:03.030239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c866382-3779-42de-ae43-b219bcb090ec None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:03.032159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2c866382-3779-42de-ae43-b219bcb090ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.038735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75560bb485b414fb562bd08f46990ed, user_id=d951d871dd314276969ad2fcd2e2a9df, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:03.042742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:03.083221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1002/1977] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:02 2022] PUT /identity/v3/projects/b75560bb485b414fb562bd08f46990ed/users/d951d871dd314276969ad2fcd2e2a9df/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:03.084025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:03.086137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.183080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b5a4d-8085-416c-ae92-fa81d2adfb85 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:03.193962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:03.195116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:03.195409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:03.195681 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] PATH_INFO: `/v3/users/5144d30d724b419eae2b8992235bc573` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:03.196880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5144d30d724b419eae2b8992235bc573)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:03.199430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:03.240713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c866382-3779-42de-ae43-b219bcb090ec None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:03.286348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5144d30d724b419eae2b8992235bc573'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.288225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5144d30d724b419eae2b8992235bc573'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.301167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5144d30d724b419eae2b8992235bc573'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.308448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5144d30d724b419eae2b8992235bc573'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.327051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b174224-8241-4188-a3f8-5d8d80f7aa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5144d30d724b419eae2b8992235bc573'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.340249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:03.362705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1003/1978] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:03 2022] DELETE /identity/v3/users/5144d30d724b419eae2b8992235bc573 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:03.365345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc343cc-2d03-4ccd-896a-28e26894626e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:03.365658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc343cc-2d03-4ccd-896a-28e26894626e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:03.366162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc343cc-2d03-4ccd-896a-28e26894626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:03.407220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ae01-3ab4-40a2-b6b4-c4d6bf82a3da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:03.407809 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ae01-3ab4-40a2-b6b4-c4d6bf82a3da service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:03.408098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ae01-3ab4-40a2-b6b4-c4d6bf82a3da service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:03.408387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ae01-3ab4-40a2-b6b4-c4d6bf82a3da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:03.414412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-13e0ae01-3ab4-40a2-b6b4-c4d6bf82a3da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.445512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-dbc343cc-2d03-4ccd-896a-28e26894626e None None] MFA Rules not processed for user `d951d871dd314276969ad2fcd2e2a9df`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:03.447292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dbc343cc-2d03-4ccd-896a-28e26894626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.555331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:03.565052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0ae01-3ab4-40a2-b6b4-c4d6bf82a3da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:03.568948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0ae01-3ab4-40a2-b6b4-c4d6bf82a3da service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:03.584604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 976/1979] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:03.586110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa0494-831d-4122-881d-73b5c2c83d03 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:03.586493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa0494-831d-4122-881d-73b5c2c83d03 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:03.586865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa0494-831d-4122-881d-73b5c2c83d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:03.586998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1004/1980] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:03.587922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc343cc-2d03-4ccd-896a-28e26894626e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:03.589568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dbc343cc-2d03-4ccd-896a-28e26894626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.612624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-49aa0494-831d-4122-881d-73b5c2c83d03 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:03.615004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-49aa0494-831d-4122-881d-73b5c2c83d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.740510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 977/1981] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:03.741916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa0494-831d-4122-881d-73b5c2c83d03 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:03.745995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-49aa0494-831d-4122-881d-73b5c2c83d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.765078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa0494-831d-4122-881d-73b5c2c83d03 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:03.766643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc343cc-2d03-4ccd-896a-28e26894626e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:03.773532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:03.774693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:03.775263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:03.775388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:03.775660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:03.776434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:03.776911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:03.777167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:03.777489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] PATH_INFO: `/v3/projects/d425b5d6f37f4dd29233cbb4e555698d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:03.778924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d425b5d6f37f4dd29233cbb4e555698d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:03.781459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:03.789045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:03.828326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 978/1982] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:03 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:03.829583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:03.836049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.858702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd425b5d6f37f4dd29233cbb4e555698d', 'request_id': 'req-250079cc-2c8a-4685-a6cf-18e16abb4e70'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.874183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd425b5d6f37f4dd29233cbb4e555698d', 'request_id': 'req-250079cc-2c8a-4685-a6cf-18e16abb4e70'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.887201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd425b5d6f37f4dd29233cbb4e555698d', 'request_id': 'req-250079cc-2c8a-4685-a6cf-18e16abb4e70'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.908276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] The token cache is being invalidate because project d425b5d6f37f4dd29233cbb4e555698d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:03.908662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.909399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:03.911913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1005/1983] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:03 2022] DELETE /identity/v3/projects/d425b5d6f37f4dd29233cbb4e555698d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:03.912774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:03.914872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:03.948804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdafe1-2eeb-4d97-bfdc-413c38718155 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:03.960322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:04.015047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.015705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.015836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250079cc-2c8a-4685-a6cf-18e16abb4e70 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:04.016248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.016248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.018383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:04.021868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.022544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.022881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.023155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.025351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:04.058677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:04.106713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.108239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.119816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.121567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.122068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1006/1984] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:04.122739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:04.127429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:04.154888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2bec9-3d6b-456a-8c5b-35739b10c290 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:04.155762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 979/1985] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:04.158049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:04.160059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:04.164821 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e7504-e08b-4eac-b825-33bdd674aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.166938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7504-e08b-4eac-b825-33bdd674aec5 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.167540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7504-e08b-4eac-b825-33bdd674aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.167990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e7504-e08b-4eac-b825-33bdd674aec5 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.175790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a14185-d6c7-4f04-86c0-deebe43530e4 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:04.184116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e7504-e08b-4eac-b825-33bdd674aec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.186791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e7504-e08b-4eac-b825-33bdd674aec5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.188538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.189839 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.191373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.191680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] PATH_INFO: `/v3/users/dfb4a9206f2d4e8e85f9b61bf03702c2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.193117 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb4a9206f2d4e8e85f9b61bf03702c2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.196039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.230191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1007/1986] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:04 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:04.236183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e7504-e08b-4eac-b825-33bdd674aec5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:04.252352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e7504-e08b-4eac-b825-33bdd674aec5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:04.278901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea564-24f0-4049-846f-d25309c1a7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.280715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea564-24f0-4049-846f-d25309c1a7ce admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.282553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea564-24f0-4049-846f-d25309c1a7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.283147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea564-24f0-4049-846f-d25309c1a7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.284492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ea564-24f0-4049-846f-d25309c1a7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.288002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ea564-24f0-4049-846f-d25309c1a7ce admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.303469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1008/1987] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:04.308293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea564-24f0-4049-846f-d25309c1a7ce admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:04.310890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb4a9206f2d4e8e85f9b61bf03702c2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.312149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb4a9206f2d4e8e85f9b61bf03702c2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.328519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb4a9206f2d4e8e85f9b61bf03702c2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.329030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb4a9206f2d4e8e85f9b61bf03702c2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.330669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea564-24f0-4049-846f-d25309c1a7ce admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:04.356545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.357526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.357938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.358420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] PATH_INFO: `/v3/projects/b78030b489c14418afa52c5a58f0643d/users/2ac81a731fca4f1da64d006205db1a2f/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.361064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb4a9206f2d4e8e85f9b61bf03702c2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.376621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78030b489c14418afa52c5a58f0643d, user_id=2ac81a731fca4f1da64d006205db1a2f, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.380651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.398760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1009/1988] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:04 2022] PUT /identity/v3/projects/b78030b489c14418afa52c5a58f0643d/users/2ac81a731fca4f1da64d006205db1a2f/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:04.402859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:04.405027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:04.406004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 980/1989] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:04 2022] DELETE /identity/v3/users/dfb4a9206f2d4e8e85f9b61bf03702c2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:04.534826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514c5ac-aee7-4c66-b29d-7252e9eb403d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:04.671225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:04.672719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:04.678341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb141e-3362-47d8-bf36-d74ece403c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.679110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb141e-3362-47d8-bf36-d74ece403c2d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.679489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb141e-3362-47d8-bf36-d74ece403c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.679867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb141e-3362-47d8-bf36-d74ece403c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.680719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb141e-3362-47d8-bf36-d74ece403c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.683127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb141e-3362-47d8-bf36-d74ece403c2d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.696551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1010/1990] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:04.701421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb141e-3362-47d8-bf36-d74ece403c2d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:04.713071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fdb99-b9d7-4da8-8cbd-1f9329d14c59 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:04.719312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb141e-3362-47d8-bf36-d74ece403c2d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:04.724759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.725876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.726388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.727272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] PATH_INFO: `/v3/users/3ffdb2b6c5744cdab47ef27a28e56f82` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.729366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffdb2b6c5744cdab47ef27a28e56f82)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.732094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.736563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e205bc-2d76-4a18-9bcb-48cd865709ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:04.737590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e205bc-2d76-4a18-9bcb-48cd865709ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.738183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e205bc-2d76-4a18-9bcb-48cd865709ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.739386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e205bc-2d76-4a18-9bcb-48cd865709ac admin admin] PATH_INFO: `/v3/projects/b78030b489c14418afa52c5a58f0643d/users/2ac81a731fca4f1da64d006205db1a2f/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.744961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e205bc-2d76-4a18-9bcb-48cd865709ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78030b489c14418afa52c5a58f0643d, user_id=2ac81a731fca4f1da64d006205db1a2f, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:04.751468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e205bc-2d76-4a18-9bcb-48cd865709ac admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:04.782697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1011/1991] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:04 2022] PUT /identity/v3/projects/b78030b489c14418afa52c5a58f0643d/users/2ac81a731fca4f1da64d006205db1a2f/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:04.794454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd4d2d-13b5-4c04-b7a9-be74cb05b665 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.794750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd4d2d-13b5-4c04-b7a9-be74cb05b665 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.795036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd4d2d-13b5-4c04-b7a9-be74cb05b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.804574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:04.806862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:04.833916 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffdb2b6c5744cdab47ef27a28e56f82'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.836120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffdb2b6c5744cdab47ef27a28e56f82'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.842779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d7bd4d2d-13b5-4c04-b7a9-be74cb05b665 None None] MFA Rules not processed for user `2ac81a731fca4f1da64d006205db1a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:04.844728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d7bd4d2d-13b5-4c04-b7a9-be74cb05b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:04.853997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffdb2b6c5744cdab47ef27a28e56f82'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.855852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffdb2b6c5744cdab47ef27a28e56f82'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.869343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-03d1c1e0-1a68-4ba2-bb91-d11d5b1b59fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffdb2b6c5744cdab47ef27a28e56f82'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:04.913501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 981/1992] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:04 2022] DELETE /identity/v3/users/3ffdb2b6c5744cdab47ef27a28e56f82 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:04.915929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b33ea-76c8-48ad-8b15-b968a4ef54e3 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:04.916341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b33ea-76c8-48ad-8b15-b968a4ef54e3 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:04.916698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b33ea-76c8-48ad-8b15-b968a4ef54e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:04.962148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-454b33ea-76c8-48ad-8b15-b968a4ef54e3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:04.963477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-454b33ea-76c8-48ad-8b15-b968a4ef54e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.042396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1012/1993] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:05.042396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd4d2d-13b5-4c04-b7a9-be74cb05b665 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.042396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d7bd4d2d-13b5-4c04-b7a9-be74cb05b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.116127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 982/1994] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:05.116127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b33ea-76c8-48ad-8b15-b968a4ef54e3 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.123090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-454b33ea-76c8-48ad-8b15-b968a4ef54e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.203760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd4d2d-13b5-4c04-b7a9-be74cb05b665 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.218640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:05.221779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.222078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.222364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] PATH_INFO: `/v3/projects/21c7c35072a44e54bf1d5b831cf56a91` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.226736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c7c35072a44e54bf1d5b831cf56a91)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:05.227779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:05.265764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b33ea-76c8-48ad-8b15-b968a4ef54e3 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.274010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:05.274807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.275211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.275591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.277955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.352185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c7c35072a44e54bf1d5b831cf56a91', 'request_id': 'req-38491a99-e6ea-4117-8117-8a1c29a14c78'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.359973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c7c35072a44e54bf1d5b831cf56a91', 'request_id': 'req-38491a99-e6ea-4117-8117-8a1c29a14c78'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.368566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c7c35072a44e54bf1d5b831cf56a91', 'request_id': 'req-38491a99-e6ea-4117-8117-8a1c29a14c78'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.378309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:05.379827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:05.387979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] The token cache is being invalidate because project 21c7c35072a44e54bf1d5b831cf56a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:05.388290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.389039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.389851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 983/1995] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:05.390931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1013/1996] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:05 2022] DELETE /identity/v3/projects/21c7c35072a44e54bf1d5b831cf56a91 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:05.391779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.393090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.393857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.396217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.403022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:05.426634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:05.475102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a6dd1-e597-41d1-8575-0154a52fd318 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.513484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38491a99-e6ea-4117-8117-8a1c29a14c78 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.518661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:05.519518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.520744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.521027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] PATH_INFO: `/v3/projects/ef35ea951bd0433a9af132bc72e0a857` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.522381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef35ea951bd0433a9af132bc72e0a857)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:05.524468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:05.544719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e799eb0-b87d-4cf3-976a-6224c729c79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:05.545344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e799eb0-b87d-4cf3-976a-6224c729c79e service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.545650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e799eb0-b87d-4cf3-976a-6224c729c79e service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.545934 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e799eb0-b87d-4cf3-976a-6224c729c79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.547757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0e799eb0-b87d-4cf3-976a-6224c729c79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.563994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e799eb0-b87d-4cf3-976a-6224c729c79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:05.565672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e799eb0-b87d-4cf3-976a-6224c729c79e service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:05.577630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 984/1997] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:05.580376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b93d02-7527-4330-9234-4dd76e063108 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.580671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b93d02-7527-4330-9234-4dd76e063108 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.581005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b93d02-7527-4330-9234-4dd76e063108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.593876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef35ea951bd0433a9af132bc72e0a857', 'request_id': 'req-e0bcf96f-b86d-4d30-a197-abb92baf8839'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.601625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef35ea951bd0433a9af132bc72e0a857', 'request_id': 'req-e0bcf96f-b86d-4d30-a197-abb92baf8839'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.607005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-46b93d02-7527-4330-9234-4dd76e063108 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:05.608769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-46b93d02-7527-4330-9234-4dd76e063108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.610795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef35ea951bd0433a9af132bc72e0a857', 'request_id': 'req-e0bcf96f-b86d-4d30-a197-abb92baf8839'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.636743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] The token cache is being invalidate because project ef35ea951bd0433a9af132bc72e0a857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:05.638084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.638918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e0bcf96f-b86d-4d30-a197-abb92baf8839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:05.644344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1014/1998] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:05 2022] DELETE /identity/v3/projects/ef35ea951bd0433a9af132bc72e0a857 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:05.647005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5950c5-381c-41fb-b704-72969f601beb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.647291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5950c5-381c-41fb-b704-72969f601beb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.647838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5950c5-381c-41fb-b704-72969f601beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.670932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3c5950c5-381c-41fb-b704-72969f601beb None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:05.672316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3c5950c5-381c-41fb-b704-72969f601beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.737177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 985/1999] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:05.738349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79edd-c729-4ce2-bbf6-ef17893a11ab None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.738664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79edd-c729-4ce2-bbf6-ef17893a11ab None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.739377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d79edd-c729-4ce2-bbf6-ef17893a11ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.774548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-14d79edd-c729-4ce2-bbf6-ef17893a11ab None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:05.778308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-14d79edd-c729-4ce2-bbf6-ef17893a11ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.790967 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1015/2000] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:05.792095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 986/2001] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:05.792221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82f2b-c408-4a39-a45b-88ec2dabcdd3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.792420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82f2b-c408-4a39-a45b-88ec2dabcdd3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.792657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82f2b-c408-4a39-a45b-88ec2dabcdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.793831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d79edd-c729-4ce2-bbf6-ef17893a11ab None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.806482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d79edd-c729-4ce2-bbf6-ef17893a11ab None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.812375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:05.813166 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.813550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.813974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.814753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:05.815740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:05.817775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:05.835798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 987/2002] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:05.837373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.847816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b579fa-cd9b-4ef2-af98-5049c3176691 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.853436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a6b82f2b-c408-4a39-a45b-88ec2dabcdd3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:05.853983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6f14-b366-4257-96e4-50ce49e198a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:05.854747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6f14-b366-4257-96e4-50ce49e198a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.854865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a6b82f2b-c408-4a39-a45b-88ec2dabcdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:05.855073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6f14-b366-4257-96e4-50ce49e198a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.855362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6f14-b366-4257-96e4-50ce49e198a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.856196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c6f14-b366-4257-96e4-50ce49e198a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:05.858291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c6f14-b366-4257-96e4-50ce49e198a5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:05.879056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1016/2003] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:05.881351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82f2b-c408-4a39-a45b-88ec2dabcdd3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.901350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82f2b-c408-4a39-a45b-88ec2dabcdd3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.907678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:05.908305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 988/2004] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:05 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:05.908616 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.908904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.909198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6f14-b366-4257-96e4-50ce49e198a5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.909316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:05.910084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:05.910618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:05.912512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:05.927895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1017/2005] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:05.933368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:05.934997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:05.954867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32455f0-043f-4dfc-baef-b6d48ed8e4c9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.992596 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6f14-b366-4257-96e4-50ce49e198a5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:05.998180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:05.998338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38ad3b-4980-453e-8d98-b6b595e7d815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:05.998922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ad3b-4980-453e-8d98-b6b595e7d815 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:05.999941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ad3b-4980-453e-8d98-b6b595e7d815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:05.999941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38ad3b-4980-453e-8d98-b6b595e7d815 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.000714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38ad3b-4980-453e-8d98-b6b595e7d815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.002720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38ad3b-4980-453e-8d98-b6b595e7d815 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.033322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 989/2006] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:05 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:06.039752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38ad3b-4980-453e-8d98-b6b595e7d815 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.054752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16ab8c-29f6-4a40-b5e9-ae8986819cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.055379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ab8c-29f6-4a40-b5e9-ae8986819cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.055597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38ad3b-4980-453e-8d98-b6b595e7d815 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.055718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ab8c-29f6-4a40-b5e9-ae8986819cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.055921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ab8c-29f6-4a40-b5e9-ae8986819cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.056562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16ab8c-29f6-4a40-b5e9-ae8986819cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.058595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16ab8c-29f6-4a40-b5e9-ae8986819cf9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.060641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.061369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.061829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.062277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.063037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.064980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.078501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 990/2007] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:06.079641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.081691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:06.095938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1018/2008] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:05 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:06.095938 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16ab8c-29f6-4a40-b5e9-ae8986819cf9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.096209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699ce75-1926-4af7-840e-8fa6f9c5768a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.157409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.158122 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.158404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.158677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16ab8c-29f6-4a40-b5e9-ae8986819cf9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.158777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] PATH_INFO: `/v3/projects/512c23fc6941435da204c836e028c95d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.159820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512c23fc6941435da204c836e028c95d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.161861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.163751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4671c3-7774-47a9-8058-048b54658c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.164349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4671c3-7774-47a9-8058-048b54658c4d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.164636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4671c3-7774-47a9-8058-048b54658c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.164912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4671c3-7774-47a9-8058-048b54658c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.165561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4671c3-7774-47a9-8058-048b54658c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.167179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4671c3-7774-47a9-8058-048b54658c4d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.178523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1019/2009] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:06.182409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4671c3-7774-47a9-8058-048b54658c4d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.195288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4671c3-7774-47a9-8058-048b54658c4d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.200153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d72d5-6b78-4430-bb57-52a2188ed5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.200762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d72d5-6b78-4430-bb57-52a2188ed5fe admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.201039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d72d5-6b78-4430-bb57-52a2188ed5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.201315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d72d5-6b78-4430-bb57-52a2188ed5fe admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.201982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d72d5-6b78-4430-bb57-52a2188ed5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.203920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d72d5-6b78-4430-bb57-52a2188ed5fe admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.211324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512c23fc6941435da204c836e028c95d', 'request_id': 'req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.218042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512c23fc6941435da204c836e028c95d', 'request_id': 'req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.225744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512c23fc6941435da204c836e028c95d', 'request_id': 'req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.227761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1020/2010] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:06 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:06.228396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d72d5-6b78-4430-bb57-52a2188ed5fe admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.238246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d72d5-6b78-4430-bb57-52a2188ed5fe admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.238403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] The token cache is being invalidate because project 512c23fc6941435da204c836e028c95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:06.238661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.239929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.241375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 991/2011] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:06 2022] DELETE /identity/v3/projects/512c23fc6941435da204c836e028c95d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:06.242368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.243703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:06.277488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:06.303534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16495-fde2-46c3-b077-39130b8eb126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.304210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16495-fde2-46c3-b077-39130b8eb126 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.304497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16495-fde2-46c3-b077-39130b8eb126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.304778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf16495-fde2-46c3-b077-39130b8eb126 admin admin] PATH_INFO: `/v3/projects/94772a27e4cf40bf9d855bd3bfc561a0/users/4eca10b8116b4952b963da40657481be/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.318345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f2730-e604-4f0d-8e2f-6a8d15be11f9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.323185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.323808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.324094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.324373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.324801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf16495-fde2-46c3-b077-39130b8eb126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94772a27e4cf40bf9d855bd3bfc561a0, user_id=4eca10b8116b4952b963da40657481be, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.325020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.326703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.328139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf16495-fde2-46c3-b077-39130b8eb126 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.340557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 992/2012] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:06.341695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.343962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:06.346410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1021/2013] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:06 2022] PUT /identity/v3/projects/94772a27e4cf40bf9d855bd3bfc561a0/users/4eca10b8116b4952b963da40657481be/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:06.347440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16495-fde2-46c3-b077-39130b8eb126 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.365870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab189c-e0fd-4ed3-91f5-d5a3381c7522 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.394230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:06.459077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf16495-fde2-46c3-b077-39130b8eb126 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.464524 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60e607-cbc7-4934-9dba-1c7bc463becd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.465198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e607-cbc7-4934-9dba-1c7bc463becd admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.465490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e607-cbc7-4934-9dba-1c7bc463becd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.465793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e607-cbc7-4934-9dba-1c7bc463becd admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.466526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60e607-cbc7-4934-9dba-1c7bc463becd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.468263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60e607-cbc7-4934-9dba-1c7bc463becd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.470933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.472039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.472384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.472726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] PATH_INFO: `/v3/users/82b6d87324bd4d2f908e7cfbc04ada8b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.474790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b6d87324bd4d2f908e7cfbc04ada8b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.477575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.480983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1022/2014] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:06.482441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83071bf-e605-4ef1-90b8-da2d518b0913 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.482898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83071bf-e605-4ef1-90b8-da2d518b0913 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.483249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83071bf-e605-4ef1-90b8-da2d518b0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.531933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e83071bf-e605-4ef1-90b8-da2d518b0913 None None] MFA Rules not processed for user `4eca10b8116b4952b963da40657481be`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:06.533649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e83071bf-e605-4ef1-90b8-da2d518b0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:06.548906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b6d87324bd4d2f908e7cfbc04ada8b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.549913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b6d87324bd4d2f908e7cfbc04ada8b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.580106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b6d87324bd4d2f908e7cfbc04ada8b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.580858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b6d87324bd4d2f908e7cfbc04ada8b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.590895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b6d87324bd4d2f908e7cfbc04ada8b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:06.614857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 993/2015] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:06 2022] DELETE /identity/v3/users/82b6d87324bd4d2f908e7cfbc04ada8b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:06.618584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.620169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:06.657659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1023/2016] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:06.670155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83071bf-e605-4ef1-90b8-da2d518b0913 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.671729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e83071bf-e605-4ef1-90b8-da2d518b0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:06.688765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:06.713803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a20efa-749a-42d7-9463-d4ada599100f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.722108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f9910-02c4-4644-95e8-47ea952135d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.722315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9910-02c4-4644-95e8-47ea952135d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.724349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9910-02c4-4644-95e8-47ea952135d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.724886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f9910-02c4-4644-95e8-47ea952135d1 admin admin] PATH_INFO: `/v3/projects/1cfe901474c5401e94f48040c53d062f/users/e1080fc101c84889965c03c102fe12b4/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.746622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f9910-02c4-4644-95e8-47ea952135d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfe901474c5401e94f48040c53d062f, user_id=e1080fc101c84889965c03c102fe12b4, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.752371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f9910-02c4-4644-95e8-47ea952135d1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.757882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83071bf-e605-4ef1-90b8-da2d518b0913 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:06.773702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 994/2017] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:06 2022] PUT /identity/v3/projects/1cfe901474c5401e94f48040c53d062f/users/e1080fc101c84889965c03c102fe12b4/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:06.785407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86f01-aba7-4052-ab93-b46a9afcd3b0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.786481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86f01-aba7-4052-ab93-b46a9afcd3b0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.786908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a86f01-aba7-4052-ab93-b46a9afcd3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.825274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-87a86f01-aba7-4052-ab93-b46a9afcd3b0 None None] MFA Rules not processed for user `e1080fc101c84889965c03c102fe12b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:06.826930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-87a86f01-aba7-4052-ab93-b46a9afcd3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:06.831970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:06.833351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:06.833796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:06.834380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:06.845042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:06.902559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:06.904100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:06.912899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 995/2018] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:06.915054 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1024/2019] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:06.917614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a86f01-aba7-4052-ab93-b46a9afcd3b0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.953964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:06.956454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:06.985755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629a5e-46c8-4d60-b490-e9c568ea382f service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.061475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a86f01-aba7-4052-ab93-b46a9afcd3b0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.067282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24272a1f-f59c-46ec-aa2d-4dbe65684124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.068527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24272a1f-f59c-46ec-aa2d-4dbe65684124 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.068814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24272a1f-f59c-46ec-aa2d-4dbe65684124 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.069572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24272a1f-f59c-46ec-aa2d-4dbe65684124 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.069828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24272a1f-f59c-46ec-aa2d-4dbe65684124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.087852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24272a1f-f59c-46ec-aa2d-4dbe65684124 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.101830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.102813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.103226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.103608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] PATH_INFO: `/v3/users/4eca10b8116b4952b963da40657481be` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.106394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eca10b8116b4952b963da40657481be)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.108653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.158653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 996/2020] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:06 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:07.159746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24272a1f-f59c-46ec-aa2d-4dbe65684124 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:07.178414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eca10b8116b4952b963da40657481be'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:07.179408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eca10b8116b4952b963da40657481be'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:07.213537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:07.217143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eca10b8116b4952b963da40657481be'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:07.240931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eca10b8116b4952b963da40657481be'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:07.271455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eca10b8116b4952b963da40657481be'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:07.277789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24272a1f-f59c-46ec-aa2d-4dbe65684124 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.293092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e1693-1620-4c75-bbdd-036cc02199ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.295071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1693-1620-4c75-bbdd-036cc02199ad admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.295637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1693-1620-4c75-bbdd-036cc02199ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.296241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1693-1620-4c75-bbdd-036cc02199ad admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.298401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e1693-1620-4c75-bbdd-036cc02199ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.304581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e1693-1620-4c75-bbdd-036cc02199ad admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.305315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1025/2021] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:06 2022] DELETE /identity/v3/users/4eca10b8116b4952b963da40657481be => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:07.307335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:07.309135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:07.344026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 997/2022] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:07 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:07.346343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157921-cb93-4bca-8971-74ac7501816b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.346821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157921-cb93-4bca-8971-74ac7501816b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.347602 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00157921-cb93-4bca-8971-74ac7501816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.361237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:07.378678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-00157921-cb93-4bca-8971-74ac7501816b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:07.381819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-00157921-cb93-4bca-8971-74ac7501816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:07.399125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1cec8-686c-4512-9aa7-c8f58d70a43c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.404553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.405473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.405952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.406534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.408708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:07.473705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 998/2023] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:07.473705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00157921-cb93-4bca-8971-74ac7501816b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:07.479236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-00157921-cb93-4bca-8971-74ac7501816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:07.498790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00157921-cb93-4bca-8971-74ac7501816b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.501447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.502928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.503734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998680a-8946-4be6-92df-901d3b63bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.506143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998680a-8946-4be6-92df-901d3b63bea9 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.506143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998680a-8946-4be6-92df-901d3b63bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.506143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998680a-8946-4be6-92df-901d3b63bea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.506401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998680a-8946-4be6-92df-901d3b63bea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.508094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998680a-8946-4be6-92df-901d3b63bea9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.513377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1026/2024] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:07.515550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:07.517260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:07.523664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 999/2025] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:07.525618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998680a-8946-4be6-92df-901d3b63bea9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:07.538811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998680a-8946-4be6-92df-901d3b63bea9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.543642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0a25-ab7c-44d2-afb4-9c543e544363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.544683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0a25-ab7c-44d2-afb4-9c543e544363 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.545634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0a25-ab7c-44d2-afb4-9c543e544363 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.545634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0a25-ab7c-44d2-afb4-9c543e544363 admin admin] PATH_INFO: `/v3/projects/8094c302114e46ea92136ca20f295210/users/cce93893b6b14bf7b6a6d4ac3566d0ad/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.565405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d0a25-ab7c-44d2-afb4-9c543e544363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8094c302114e46ea92136ca20f295210, user_id=cce93893b6b14bf7b6a6d4ac3566d0ad, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.570044 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d0a25-ab7c-44d2-afb4-9c543e544363 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.593634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1000/2026] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:07 2022] PUT /identity/v3/projects/8094c302114e46ea92136ca20f295210/users/cce93893b6b14bf7b6a6d4ac3566d0ad/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:07.595369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0a25-ab7c-44d2-afb4-9c543e544363 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:07.612823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68490f6d-597b-48d4-b2e7-ac0e61d43467 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.716588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.717220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.717505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.720369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.731073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0a25-ab7c-44d2-afb4-9c543e544363 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.737838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.740519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.742661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69402ce-368c-4e50-8c91-321cb930dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.743751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69402ce-368c-4e50-8c91-321cb930dc8c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.744364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69402ce-368c-4e50-8c91-321cb930dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.745059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69402ce-368c-4e50-8c91-321cb930dc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.746017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69402ce-368c-4e50-8c91-321cb930dc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.748213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69402ce-368c-4e50-8c91-321cb930dc8c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.753124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1027/2027] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:07.754030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:07.756761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:07.770270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1001/2028] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:07.775727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69402ce-368c-4e50-8c91-321cb930dc8c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:07.803832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69402ce-368c-4e50-8c91-321cb930dc8c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.804895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec168e-2711-4205-ae46-5a2a70bc2a8e service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:07.811267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf475bd-7742-4902-8327-a0b3281bbff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.812303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf475bd-7742-4902-8327-a0b3281bbff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.812900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf475bd-7742-4902-8327-a0b3281bbff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.813387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf475bd-7742-4902-8327-a0b3281bbff7 admin admin] PATH_INFO: `/v3/projects/8094c302114e46ea92136ca20f295210/users/cce93893b6b14bf7b6a6d4ac3566d0ad/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.816063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf475bd-7742-4902-8327-a0b3281bbff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8094c302114e46ea92136ca20f295210, user_id=cce93893b6b14bf7b6a6d4ac3566d0ad, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.820900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf475bd-7742-4902-8327-a0b3281bbff7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.821155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:07.821840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.822257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.822540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] PATH_INFO: `/v3/projects/d2c55d6ca6ec4dc98da49930007e0e91` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.823781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c55d6ca6ec4dc98da49930007e0e91)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:07.825816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:07.844094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1002/2029] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:07 2022] PUT /identity/v3/projects/8094c302114e46ea92136ca20f295210/users/cce93893b6b14bf7b6a6d4ac3566d0ad/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:07.854777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f329e3-0aac-4f55-8ff0-5b93e2e6e455 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:07.855463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f329e3-0aac-4f55-8ff0-5b93e2e6e455 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:07.855971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f329e3-0aac-4f55-8ff0-5b93e2e6e455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:07.925781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-60f329e3-0aac-4f55-8ff0-5b93e2e6e455 None None] MFA Rules not processed for user `cce93893b6b14bf7b6a6d4ac3566d0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:07.928542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-60f329e3-0aac-4f55-8ff0-5b93e2e6e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:07.938844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:07.943231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:07.959807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c55d6ca6ec4dc98da49930007e0e91', 'request_id': 'req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:07.969254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c55d6ca6ec4dc98da49930007e0e91', 'request_id': 'req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:07.980086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c55d6ca6ec4dc98da49930007e0e91', 'request_id': 'req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:08.017742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] The token cache is being invalidate because project d2c55d6ca6ec4dc98da49930007e0e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:08.018139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:08.023747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e8debe69-7ed3-4ec7-8ab3-ee4e75d7ef27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:08.029431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1028/2030] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:07 2022] DELETE /identity/v3/projects/d2c55d6ca6ec4dc98da49930007e0e91 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:08.031679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08115-5ed5-49ba-b840-d5d1f714be84 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.032122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08115-5ed5-49ba-b840-d5d1f714be84 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.033142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08115-5ed5-49ba-b840-d5d1f714be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.092428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c7a08115-5ed5-49ba-b840-d5d1f714be84 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:08.094160 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c7a08115-5ed5-49ba-b840-d5d1f714be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.146891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1003/2031] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:08.162185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f329e3-0aac-4f55-8ff0-5b93e2e6e455 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.164345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-60f329e3-0aac-4f55-8ff0-5b93e2e6e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.235720 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1029/2032] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:08.245073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c161102-6845-4fc9-bea8-d423d0ba054d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.245381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c161102-6845-4fc9-bea8-d423d0ba054d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.245639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c161102-6845-4fc9-bea8-d423d0ba054d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.268107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f329e3-0aac-4f55-8ff0-5b93e2e6e455 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.275823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8c161102-6845-4fc9-bea8-d423d0ba054d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:08.276597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0a7b0-0692-4a2e-a255-60b56a04787d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.277232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a7b0-0692-4a2e-a255-60b56a04787d service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.277718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a7b0-0692-4a2e-a255-60b56a04787d service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.277822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a7b0-0692-4a2e-a255-60b56a04787d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.279348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8c161102-6845-4fc9-bea8-d423d0ba054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.295011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0a7b0-0692-4a2e-a255-60b56a04787d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.297106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0a7b0-0692-4a2e-a255-60b56a04787d service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.308989 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1030/2033] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:08.313031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c161102-6845-4fc9-bea8-d423d0ba054d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.317260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1004/2034] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:08.337281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c161102-6845-4fc9-bea8-d423d0ba054d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.349806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.351647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.361859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.363111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.364462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:08.367857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.370129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.404433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1031/2035] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:08.409119 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0a7b0-0692-4a2e-a255-60b56a04787d service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.424825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0a7b0-0692-4a2e-a255-60b56a04787d service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.441219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.442095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.442236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.442547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.443192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.445260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.468925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.482549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fdf15-4e4b-41a5-a45c-ae1240a5b248 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.496224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.497171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.497507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.497882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.501111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1005/2036] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:08 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:08.502482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.505315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.507217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.605648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f627b-e24e-422b-a50d-6c0573fcece9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.610412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.611058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.611345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.611620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] PATH_INFO: `/v3/projects/94772a27e4cf40bf9d855bd3bfc561a0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.612752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94772a27e4cf40bf9d855bd3bfc561a0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.613131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.614675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.614809 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.624816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1032/2037] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:08.625474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.637423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67605250-b0cf-4f30-afb2-6e4dabfa900b service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.642794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.643650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.644009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.644354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.646653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.649016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.655898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:08.681148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1033/2038] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:08 2022] POST /identity/v3/users => generated 285 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:08.682403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.683646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94772a27e4cf40bf9d855bd3bfc561a0', 'request_id': 'req-180da46c-5cbb-4c27-b774-cc5f6b1450d5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:08.686639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.690641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94772a27e4cf40bf9d855bd3bfc561a0', 'request_id': 'req-180da46c-5cbb-4c27-b774-cc5f6b1450d5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:08.702569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94772a27e4cf40bf9d855bd3bfc561a0', 'request_id': 'req-180da46c-5cbb-4c27-b774-cc5f6b1450d5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:08.718431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] The token cache is being invalidate because project 94772a27e4cf40bf9d855bd3bfc561a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:08.718796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:08.719570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:08.721516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1006/2039] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:08 2022] DELETE /identity/v3/projects/94772a27e4cf40bf9d855bd3bfc561a0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:08.722599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.725038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.739610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:08.776256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1567b-d5de-49ba-b421-8d1e2e58af62 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.845631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180da46c-5cbb-4c27-b774-cc5f6b1450d5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.853252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f982c8-71a7-4146-81f7-74a9707baa18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.853915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f982c8-71a7-4146-81f7-74a9707baa18 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.854198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f982c8-71a7-4146-81f7-74a9707baa18 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.854944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f982c8-71a7-4146-81f7-74a9707baa18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.856261 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-43f982c8-71a7-4146-81f7-74a9707baa18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.856370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb86c4-0336-47ee-85cf-cbe22dd528ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.857088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb86c4-0336-47ee-85cf-cbe22dd528ea admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.857337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb86c4-0336-47ee-85cf-cbe22dd528ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.857652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb86c4-0336-47ee-85cf-cbe22dd528ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.858367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb86c4-0336-47ee-85cf-cbe22dd528ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.860152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb86c4-0336-47ee-85cf-cbe22dd528ea admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.874986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1007/2040] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:08.876296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439445-3f31-4c00-8553-d22de47d4dba None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.876600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439445-3f31-4c00-8553-d22de47d4dba None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.876875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3439445-3f31-4c00-8553-d22de47d4dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.902006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f3439445-3f31-4c00-8553-d22de47d4dba None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:08.903248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f3439445-3f31-4c00-8553-d22de47d4dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.911827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1008/2041] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:08.919210 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3439445-3f31-4c00-8553-d22de47d4dba None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.930129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3439445-3f31-4c00-8553-d22de47d4dba None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.930316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f982c8-71a7-4146-81f7-74a9707baa18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.931747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f982c8-71a7-4146-81f7-74a9707baa18 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.935017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac8a0-3e2a-425a-86ad-fc8e2ed6b31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.935633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac8a0-3e2a-425a-86ad-fc8e2ed6b31b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.935914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac8a0-3e2a-425a-86ad-fc8e2ed6b31b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.936190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ac8a0-3e2a-425a-86ad-fc8e2ed6b31b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.936834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ac8a0-3e2a-425a-86ad-fc8e2ed6b31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.938536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ac8a0-3e2a-425a-86ad-fc8e2ed6b31b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:08.944218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1034/2042] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:08.946203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4344b5d-25f9-4cf7-a9dc-7805512994bb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.946882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4344b5d-25f9-4cf7-a9dc-7805512994bb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.946882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4344b5d-25f9-4cf7-a9dc-7805512994bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.950957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1009/2043] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:08.954786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac8a0-3e2a-425a-86ad-fc8e2ed6b31b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.966626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ac8a0-3e2a-425a-86ad-fc8e2ed6b31b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:08.972684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335d1c-4d74-4a4d-b791-f0290d13cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:08.974829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335d1c-4d74-4a4d-b791-f0290d13cbb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:08.974829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335d1c-4d74-4a4d-b791-f0290d13cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:08.974829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335d1c-4d74-4a4d-b791-f0290d13cbb1 admin admin] PATH_INFO: `/v3/projects/f65b7a7b748b40c181ebe4c7ddbbf56d/users/5d025e0bcfae4996bab1166a765d0e62/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:08.976188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f4344b5d-25f9-4cf7-a9dc-7805512994bb None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:08.977969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f4344b5d-25f9-4cf7-a9dc-7805512994bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:08.991360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1035/2044] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:08.992893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc335d1c-4d74-4a4d-b791-f0290d13cbb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65b7a7b748b40c181ebe4c7ddbbf56d, user_id=5d025e0bcfae4996bab1166a765d0e62, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:08.996017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4344b5d-25f9-4cf7-a9dc-7805512994bb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:08.996256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc335d1c-4d74-4a4d-b791-f0290d13cbb1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.007566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4344b5d-25f9-4cf7-a9dc-7805512994bb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:09.016561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1010/2045] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:08 2022] PUT /identity/v3/projects/f65b7a7b748b40c181ebe4c7ddbbf56d/users/5d025e0bcfae4996bab1166a765d0e62/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:09.030511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5935e89-b10a-4e8a-92fe-cd9a36a182dc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.030945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5935e89-b10a-4e8a-92fe-cd9a36a182dc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.031325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5935e89-b10a-4e8a-92fe-cd9a36a182dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.132037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c5935e89-b10a-4e8a-92fe-cd9a36a182dc None None] MFA Rules not processed for user `5d025e0bcfae4996bab1166a765d0e62`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:09.133414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c5935e89-b10a-4e8a-92fe-cd9a36a182dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:09.143484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:09.144336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.144474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.145303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.146337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:09.146756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:09.150012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.184390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1036/2046] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:50:09.189090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:09.210183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906cd0a-b097-4af5-ad04-186d31890eba admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:09.216095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cc438-699f-4347-bd1c-e7b22bbf53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:09.216845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc438-699f-4347-bd1c-e7b22bbf53b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.217246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc438-699f-4347-bd1c-e7b22bbf53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.218103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cc438-699f-4347-bd1c-e7b22bbf53b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.218760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cc438-699f-4347-bd1c-e7b22bbf53b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:09.221943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cc438-699f-4347-bd1c-e7b22bbf53b1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.247434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:09.260576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:09.270207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1011/2047] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:09.271272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5935e89-b10a-4e8a-92fe-cd9a36a182dc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:09.274221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c5935e89-b10a-4e8a-92fe-cd9a36a182dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:09.280352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1037/2048] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:09 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:09.285664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cc438-699f-4347-bd1c-e7b22bbf53b1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:09.371508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cc438-699f-4347-bd1c-e7b22bbf53b1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:09.376687 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f10e8-23eb-4a33-973e-deaf559c3b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:09.377437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f10e8-23eb-4a33-973e-deaf559c3b0a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.377982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f10e8-23eb-4a33-973e-deaf559c3b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.378728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f10e8-23eb-4a33-973e-deaf559c3b0a admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.379082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f10e8-23eb-4a33-973e-deaf559c3b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:09.381985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f10e8-23eb-4a33-973e-deaf559c3b0a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.384960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5935e89-b10a-4e8a-92fe-cd9a36a182dc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:09.408718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1038/2049] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:09 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:09.413066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f10e8-23eb-4a33-973e-deaf559c3b0a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:09.428536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f10e8-23eb-4a33-973e-deaf559c3b0a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:09.435884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e5ff-601d-40d5-a0c9-7db25784b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:09.436650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e5ff-601d-40d5-a0c9-7db25784b682 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.437033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e5ff-601d-40d5-a0c9-7db25784b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.437574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2e5ff-601d-40d5-a0c9-7db25784b682 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.438230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2e5ff-601d-40d5-a0c9-7db25784b682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:09.440233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2e5ff-601d-40d5-a0c9-7db25784b682 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.455412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1039/2050] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:09.460413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e5ff-601d-40d5-a0c9-7db25784b682 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:09.474720 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2e5ff-601d-40d5-a0c9-7db25784b682 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:09.485131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28d11f-1102-4842-a5a1-c7ce72e17d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:09.485865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28d11f-1102-4842-a5a1-c7ce72e17d1d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.486146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28d11f-1102-4842-a5a1-c7ce72e17d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.486417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28d11f-1102-4842-a5a1-c7ce72e17d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.487069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28d11f-1102-4842-a5a1-c7ce72e17d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:09.489520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28d11f-1102-4842-a5a1-c7ce72e17d1d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.490810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdb8a57a383c475caff51c3d6d5c6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:09.491810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.492599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.493022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.503196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1040/2051] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:09.507418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28d11f-1102-4842-a5a1-c7ce72e17d1d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:09.522492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28d11f-1102-4842-a5a1-c7ce72e17d1d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:09.527629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b1013-9060-4ecf-bb46-7346c8e065da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:09.528493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1013-9060-4ecf-bb46-7346c8e065da admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.528876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1013-9060-4ecf-bb46-7346c8e065da admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.529378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1013-9060-4ecf-bb46-7346c8e065da admin admin] PATH_INFO: `/v3/projects/c7aa367839cf4cc9833541b1e6d362be/users/2cf5c941f14746cda4bf0c3491fc98da/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.551974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b1013-9060-4ecf-bb46-7346c8e065da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7aa367839cf4cc9833541b1e6d362be, user_id=2cf5c941f14746cda4bf0c3491fc98da, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:09.557511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b1013-9060-4ecf-bb46-7346c8e065da admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.570176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:09.571631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.580230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1041/2052] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:09 2022] PUT /identity/v3/projects/c7aa367839cf4cc9833541b1e6d362be/users/2cf5c941f14746cda4bf0c3491fc98da/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:09.591299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1570e-dd44-46c0-84e5-d92a7336c891 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.591682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1570e-dd44-46c0-84e5-d92a7336c891 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.592035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1012/2053] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:09.593389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1570e-dd44-46c0-84e5-d92a7336c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.629632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-41b1570e-dd44-46c0-84e5-d92a7336c891 None None] MFA Rules not processed for user `2cf5c941f14746cda4bf0c3491fc98da`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:09.631159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-41b1570e-dd44-46c0-84e5-d92a7336c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:09.713846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1042/2054] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:09.725253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:09.731067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:09.795113 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe82581-1fb5-4198-821a-ab4993484055 service glance] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:09.804091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:09.861936 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:09.862644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:09.862825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:09.863103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:09.872157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:09.873557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:09.889752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1013/2055] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:11.452435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cddf5-e0d9-4739-b108-4f7c0fd564b2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:11.453546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cddf5-e0d9-4739-b108-4f7c0fd564b2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:11.453867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cddf5-e0d9-4739-b108-4f7c0fd564b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:11.478357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:11.479816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:11.480332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-db4cddf5-e0d9-4739-b108-4f7c0fd564b2 None None] MFA Rules not processed for user `2cf5c941f14746cda4bf0c3491fc98da`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:11.481567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-db4cddf5-e0d9-4739-b108-4f7c0fd564b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:11.488707 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1043/2056] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:11.566575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c980cc-4e54-4e7a-937f-c0b1b19705a2 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:11.571196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:11.571831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:11.572114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:11.572387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] PATH_INFO: `/v3/users/063da0983af548fe90761a0ddd4f5aeb` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:11.573513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063da0983af548fe90761a0ddd4f5aeb)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:11.575481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:11.631747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063da0983af548fe90761a0ddd4f5aeb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:11.632523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063da0983af548fe90761a0ddd4f5aeb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:11.640297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063da0983af548fe90761a0ddd4f5aeb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:11.646110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063da0983af548fe90761a0ddd4f5aeb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:11.664151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b714736b-79ce-43ca-99ba-549cb8dfb159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063da0983af548fe90761a0ddd4f5aeb'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:11.682175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1014/2057] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:11 2022] DELETE /identity/v3/users/063da0983af548fe90761a0ddd4f5aeb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:11.865446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cddf5-e0d9-4739-b108-4f7c0fd564b2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:11.880206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cddf5-e0d9-4739-b108-4f7c0fd564b2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:11.928125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:11.998781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:11.999653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:11.999941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.000549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] PATH_INFO: `/v3/projects/d3035a9299684401a9d7bfceac221704` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.016425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3035a9299684401a9d7bfceac221704)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:12.017757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:12.174804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3035a9299684401a9d7bfceac221704', 'request_id': 'req-533891e1-07da-4467-8815-e2b0957bc4b3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:12.193232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3035a9299684401a9d7bfceac221704', 'request_id': 'req-533891e1-07da-4467-8815-e2b0957bc4b3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:12.204820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3035a9299684401a9d7bfceac221704', 'request_id': 'req-533891e1-07da-4467-8815-e2b0957bc4b3'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:12.242337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] The token cache is being invalidate because project d3035a9299684401a9d7bfceac221704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:12.242646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:12.243857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-533891e1-07da-4467-8815-e2b0957bc4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:12.248904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1044/2058] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:11 2022] DELETE /identity/v3/projects/d3035a9299684401a9d7bfceac221704 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:12.251417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309139ce-4b8e-4ffa-93d5-3e0efc19e82b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.252036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309139ce-4b8e-4ffa-93d5-3e0efc19e82b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.252467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309139ce-4b8e-4ffa-93d5-3e0efc19e82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.295317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-309139ce-4b8e-4ffa-93d5-3e0efc19e82b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:12.296925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-309139ce-4b8e-4ffa-93d5-3e0efc19e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:12.331966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:12.394142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1015/2059] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:12.400336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cd72-faab-4e03-a343-750ab0eb9a7f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.401619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cd72-faab-4e03-a343-750ab0eb9a7f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.402145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cd72-faab-4e03-a343-750ab0eb9a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.427758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f5e1cd72-faab-4e03-a343-750ab0eb9a7f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:12.429504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f5e1cd72-faab-4e03-a343-750ab0eb9a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:12.440124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1045/2060] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:12.468617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309139ce-4b8e-4ffa-93d5-3e0efc19e82b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:12.491204 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309139ce-4b8e-4ffa-93d5-3e0efc19e82b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:12.497873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:12.498808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.499269 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.499698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.500686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:12.501145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:12.502998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:12.516718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1016/2061] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:12.521826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1cd72-faab-4e03-a343-750ab0eb9a7f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:12.531984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1cd72-faab-4e03-a343-750ab0eb9a7f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:12.538578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d058ed0-a046-4100-a718-62df8257289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:12.539471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d058ed0-a046-4100-a718-62df8257289e admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.539784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d058ed0-a046-4100-a718-62df8257289e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.540209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d058ed0-a046-4100-a718-62df8257289e admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.541032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d058ed0-a046-4100-a718-62df8257289e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:12.543300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d058ed0-a046-4100-a718-62df8257289e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:12.574125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1046/2062] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:12 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:12.577728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:12.588332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607af74-58d9-45de-bfc5-659c83cd58c2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:12.654575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c544b3-481a-40e1-8f0b-00f2dd91241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:12.655203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c544b3-481a-40e1-8f0b-00f2dd91241c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.655581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c544b3-481a-40e1-8f0b-00f2dd91241c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.655959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c544b3-481a-40e1-8f0b-00f2dd91241c admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.656607 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c544b3-481a-40e1-8f0b-00f2dd91241c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:12.658891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c544b3-481a-40e1-8f0b-00f2dd91241c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:12.682817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1017/2063] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:12 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:12.687377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d058ed0-a046-4100-a718-62df8257289e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:12.700565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d058ed0-a046-4100-a718-62df8257289e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:12.706965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f19b0-1f16-4d57-b3da-bc3e1314c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:12.707603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f19b0-1f16-4d57-b3da-bc3e1314c438 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.707885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f19b0-1f16-4d57-b3da-bc3e1314c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.708164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f19b0-1f16-4d57-b3da-bc3e1314c438 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.708811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f19b0-1f16-4d57-b3da-bc3e1314c438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:12.710547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f19b0-1f16-4d57-b3da-bc3e1314c438 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:12.722140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1047/2064] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:12.727034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c544b3-481a-40e1-8f0b-00f2dd91241c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:12.738246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c544b3-481a-40e1-8f0b-00f2dd91241c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:12.747574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4830b-0106-41c4-887d-e775cfa0fee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:12.748338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4830b-0106-41c4-887d-e775cfa0fee9 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.748624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4830b-0106-41c4-887d-e775cfa0fee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.748902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4830b-0106-41c4-887d-e775cfa0fee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.749554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4830b-0106-41c4-887d-e775cfa0fee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:12.751213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4830b-0106-41c4-887d-e775cfa0fee9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:12.765716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1018/2065] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:12.768005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f19b0-1f16-4d57-b3da-bc3e1314c438 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:12.778443 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f19b0-1f16-4d57-b3da-bc3e1314c438 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:12.783528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86c83-75e2-4623-a4aa-d4d6bc940f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:12.784232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c83-75e2-4623-a4aa-d4d6bc940f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.784517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c83-75e2-4623-a4aa-d4d6bc940f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.784796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c83-75e2-4623-a4aa-d4d6bc940f20 admin admin] PATH_INFO: `/v3/projects/66c158aa5c1442fd92a5edf02b2f284a/users/f9994898bc7b4fa987048823627d3fc6/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.803386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb86c83-75e2-4623-a4aa-d4d6bc940f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c158aa5c1442fd92a5edf02b2f284a, user_id=f9994898bc7b4fa987048823627d3fc6, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:12.806126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb86c83-75e2-4623-a4aa-d4d6bc940f20 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:12.818799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1048/2066] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:12 2022] PUT /identity/v3/projects/66c158aa5c1442fd92a5edf02b2f284a/users/f9994898bc7b4fa987048823627d3fc6/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:12.828903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90835a1-5f9a-4c58-aa2f-b2797b8a4aee None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:12.829225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90835a1-5f9a-4c58-aa2f-b2797b8a4aee None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:12.829532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90835a1-5f9a-4c58-aa2f-b2797b8a4aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:12.862263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d90835a1-5f9a-4c58-aa2f-b2797b8a4aee None None] MFA Rules not processed for user `f9994898bc7b4fa987048823627d3fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:12.864181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d90835a1-5f9a-4c58-aa2f-b2797b8a4aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:12.937907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1019/2067] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:12.942551 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86c83-75e2-4623-a4aa-d4d6bc940f20 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:12.997698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:13.010445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86c83-75e2-4623-a4aa-d4d6bc940f20 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:13.016796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cb101-7fcc-4297-93c4-2ddbe88129dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:13.017540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb101-7fcc-4297-93c4-2ddbe88129dc admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.017921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb101-7fcc-4297-93c4-2ddbe88129dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.018267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cb101-7fcc-4297-93c4-2ddbe88129dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.018986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cb101-7fcc-4297-93c4-2ddbe88129dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:13.021567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cb101-7fcc-4297-93c4-2ddbe88129dc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:13.050593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1049/2068] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:12 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:13.054573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90835a1-5f9a-4c58-aa2f-b2797b8a4aee None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:13.066244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90835a1-5f9a-4c58-aa2f-b2797b8a4aee None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:13.089000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:13.133461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46525a04-b0e7-442a-8e87-0b2780473543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:13.134160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46525a04-b0e7-442a-8e87-0b2780473543 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.134443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46525a04-b0e7-442a-8e87-0b2780473543 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.134721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46525a04-b0e7-442a-8e87-0b2780473543 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.136641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46525a04-b0e7-442a-8e87-0b2780473543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:13.137324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46525a04-b0e7-442a-8e87-0b2780473543 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:13.163736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1020/2069] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:13 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:13.164970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cb101-7fcc-4297-93c4-2ddbe88129dc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:13.180463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cb101-7fcc-4297-93c4-2ddbe88129dc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:13.183627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4be7f6-beef-402a-8245-091c1b6b3e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:13.184285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4be7f6-beef-402a-8245-091c1b6b3e7b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.184568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4be7f6-beef-402a-8245-091c1b6b3e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.184883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4be7f6-beef-402a-8245-091c1b6b3e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.185520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4be7f6-beef-402a-8245-091c1b6b3e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:13.187178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4be7f6-beef-402a-8245-091c1b6b3e7b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:13.198594 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1050/2070] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:13.202828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46525a04-b0e7-442a-8e87-0b2780473543 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:13.213161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46525a04-b0e7-442a-8e87-0b2780473543 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:13.217978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1d445-b108-470f-9257-0d19994f8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:13.218634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1d445-b108-470f-9257-0d19994f8c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.218933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1d445-b108-470f-9257-0d19994f8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.219206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1d445-b108-470f-9257-0d19994f8c1a admin admin] PATH_INFO: `/v3/projects/444bd68c44d0483483893c4dcb210616/users/e3fc36c8a4b6472580733a05002e82a0/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.235454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1d445-b108-470f-9257-0d19994f8c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=444bd68c44d0483483893c4dcb210616, user_id=e3fc36c8a4b6472580733a05002e82a0, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:13.238252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1d445-b108-470f-9257-0d19994f8c1a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:13.255106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1021/2071] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:13 2022] PUT /identity/v3/projects/444bd68c44d0483483893c4dcb210616/users/e3fc36c8a4b6472580733a05002e82a0/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:13.272876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4be7f6-beef-402a-8245-091c1b6b3e7b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:13.278693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4be7f6-beef-402a-8245-091c1b6b3e7b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:13.350104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb2727-e80d-461d-b60a-9d2fbe46fb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:13.350969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2727-e80d-461d-b60a-9d2fbe46fb64 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.351250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2727-e80d-461d-b60a-9d2fbe46fb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.351523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb2727-e80d-461d-b60a-9d2fbe46fb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.352159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb2727-e80d-461d-b60a-9d2fbe46fb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:13.353845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb2727-e80d-461d-b60a-9d2fbe46fb64 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:13.365745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1051/2072] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:13.370854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1d445-b108-470f-9257-0d19994f8c1a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:13.385321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1d445-b108-470f-9257-0d19994f8c1a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:13.390226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:13.390974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.391270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.391547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] PATH_INFO: `/v3/projects/444bd68c44d0483483893c4dcb210616/users/e3fc36c8a4b6472580733a05002e82a0/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.393946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444bd68c44d0483483893c4dcb210616, user_id=e3fc36c8a4b6472580733a05002e82a0, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:13.397810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:13.409238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1022/2073] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:13 2022] PUT /identity/v3/projects/444bd68c44d0483483893c4dcb210616/users/e3fc36c8a4b6472580733a05002e82a0/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:13.422328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a291b-735e-42cf-bb52-ecd3b4cdf0ce None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.422914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a291b-735e-42cf-bb52-ecd3b4cdf0ce None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.423222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a291b-735e-42cf-bb52-ecd3b4cdf0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.455581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b32a291b-735e-42cf-bb52-ecd3b4cdf0ce None None] MFA Rules not processed for user `e3fc36c8a4b6472580733a05002e82a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:13.456816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b32a291b-735e-42cf-bb52-ecd3b4cdf0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:13.565578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:13.568292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:13.582184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1052/2074] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:13.603302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a291b-735e-42cf-bb52-ecd3b4cdf0ce None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:13.604715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b32a291b-735e-42cf-bb52-ecd3b4cdf0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:13.708568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:13.718106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae29c2-b27b-4b12-8212-4d0bbef95b05 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:13.720118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a291b-735e-42cf-bb52-ecd3b4cdf0ce None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:13.736724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:13.737548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.738089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.738430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] PATH_INFO: `/v3/users/7d2762bf55b041468f270e91a5ddb973` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.740721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11434-30db-4379-a6f2-7a42e92145ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:13.741342 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2762bf55b041468f270e91a5ddb973)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:13.741847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11434-30db-4379-a6f2-7a42e92145ff service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.742361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11434-30db-4379-a6f2-7a42e92145ff service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.742784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11434-30db-4379-a6f2-7a42e92145ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.743991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:13.755210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11434-30db-4379-a6f2-7a42e92145ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:13.757182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11434-30db-4379-a6f2-7a42e92145ff service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:13.788973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1053/2075] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:13.855620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2762bf55b041468f270e91a5ddb973'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:13.856374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2762bf55b041468f270e91a5ddb973'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:13.873248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2762bf55b041468f270e91a5ddb973'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:13.874152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2762bf55b041468f270e91a5ddb973'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:13.885420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2762bf55b041468f270e91a5ddb973'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:13.900751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:13.929021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1023/2076] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:13 2022] DELETE /identity/v3/users/7d2762bf55b041468f270e91a5ddb973 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:13.931266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8511f-a6cd-4a76-a7fb-8b73f2387cc1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:13.931653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8511f-a6cd-4a76-a7fb-8b73f2387cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:13.932480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8511f-a6cd-4a76-a7fb-8b73f2387cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:13.979113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7cc8511f-a6cd-4a76-a7fb-8b73f2387cc1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:13.980351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7cc8511f-a6cd-4a76-a7fb-8b73f2387cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:14.069692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1054/2077] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:14.077827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:14.079799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:14.150528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534f9-85b0-44b6-b518-90c01e923032 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:14.154608 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:14.155457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:14.155781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:14.156124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:14.168218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:14.174529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:14.186617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1024/2078] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:14.484161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8511f-a6cd-4a76-a7fb-8b73f2387cc1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:14.487153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7cc8511f-a6cd-4a76-a7fb-8b73f2387cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:14.503071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8511f-a6cd-4a76-a7fb-8b73f2387cc1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:14.508131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:14.508726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:14.509009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:14.509265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] PATH_INFO: `/v3/users/f9994898bc7b4fa987048823627d3fc6` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:14.510560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9994898bc7b4fa987048823627d3fc6)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:14.512487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:14.576745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9994898bc7b4fa987048823627d3fc6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.577415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9994898bc7b4fa987048823627d3fc6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.586944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9994898bc7b4fa987048823627d3fc6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.587848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9994898bc7b4fa987048823627d3fc6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.597264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:14.600852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:14.612056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-909f4f11-6a18-42e6-bfad-02748ce89167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9994898bc7b4fa987048823627d3fc6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.619563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d03b9f-8b80-41bb-a39e-c97d6533aa78 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:14.639564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:14.640067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:14.640280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:14.640554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] PATH_INFO: `/v3/projects/faf6aa9ec59647d1b5d348ef31382e3b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:14.641732 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf6aa9ec59647d1b5d348ef31382e3b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:14.643662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:14.657330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1055/2079] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:14 2022] DELETE /identity/v3/users/f9994898bc7b4fa987048823627d3fc6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:14.662466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab2216-0935-47d4-8756-0de666663b6c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:14.662848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab2216-0935-47d4-8756-0de666663b6c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:14.663134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab2216-0935-47d4-8756-0de666663b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:14.695487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-19ab2216-0935-47d4-8756-0de666663b6c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:14.696730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-19ab2216-0935-47d4-8756-0de666663b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:14.739858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf6aa9ec59647d1b5d348ef31382e3b', 'request_id': 'req-36f5a53c-0478-473b-94c4-6cb196aea66a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.747723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf6aa9ec59647d1b5d348ef31382e3b', 'request_id': 'req-36f5a53c-0478-473b-94c4-6cb196aea66a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.757019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf6aa9ec59647d1b5d348ef31382e3b', 'request_id': 'req-36f5a53c-0478-473b-94c4-6cb196aea66a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.772427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] The token cache is being invalidate because project faf6aa9ec59647d1b5d348ef31382e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:14.773051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.773859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.775542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1025/2080] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:14 2022] DELETE /identity/v3/projects/faf6aa9ec59647d1b5d348ef31382e3b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:14.778302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1056/2081] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:14.779603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:14.780953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:14.789447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab2216-0935-47d4-8756-0de666663b6c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:14.791649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-19ab2216-0935-47d4-8756-0de666663b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:14.800727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:14.859902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5a53c-0478-473b-94c4-6cb196aea66a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:14.865966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:14.866863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:14.867152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:14.867568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] PATH_INFO: `/v3/users/d951d871dd314276969ad2fcd2e2a9df` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:14.868903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d951d871dd314276969ad2fcd2e2a9df)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:14.871178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:14.872455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab2216-0935-47d4-8756-0de666663b6c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:14.904832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:14.940386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd951d871dd314276969ad2fcd2e2a9df'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.941239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd951d871dd314276969ad2fcd2e2a9df'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.941356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:14.942476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:14.942755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:14.943027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:14.945341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:14.952921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd951d871dd314276969ad2fcd2e2a9df'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.953758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd951d871dd314276969ad2fcd2e2a9df'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.968830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd951d871dd314276969ad2fcd2e2a9df'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:14.970692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:14.974242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:14.990608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1057/2082] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:14.991982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1026/2083] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:14 2022] DELETE /identity/v3/users/d951d871dd314276969ad2fcd2e2a9df => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:15.457207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:15.471504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed9eb-7312-4716-a96f-be4dd3876c57 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:15.553847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:15.554538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:15.554805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:15.555077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] PATH_INFO: `/v3/projects/b75560bb485b414fb562bd08f46990ed` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:15.556224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75560bb485b414fb562bd08f46990ed)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:15.558420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:15.623803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75560bb485b414fb562bd08f46990ed', 'request_id': 'req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.632134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75560bb485b414fb562bd08f46990ed', 'request_id': 'req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.638803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75560bb485b414fb562bd08f46990ed', 'request_id': 'req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.642163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:15.662288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] The token cache is being invalidate because project b75560bb485b414fb562bd08f46990ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:15.662592 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.663269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.665540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1058/2084] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:15 2022] DELETE /identity/v3/projects/b75560bb485b414fb562bd08f46990ed => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:15.669320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:15.671063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:15.689101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695c6a0-09d9-4dd2-bca3-e833916c8ba0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:15.745579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:15.747367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:15.808128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:15.809470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:15.809949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:15.810296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] PATH_INFO: `/v3/users/2ac81a731fca4f1da64d006205db1a2f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:15.811605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac81a731fca4f1da64d006205db1a2f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:15.815419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:15.906390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3e606-1a77-41b1-8bd5-79b64f1f7f40 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:15.917795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:15.918758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:15.919089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:15.920268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] PATH_INFO: `/v3/projects/66c158aa5c1442fd92a5edf02b2f284a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:15.922743 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c158aa5c1442fd92a5edf02b2f284a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:15.924944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:15.939003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac81a731fca4f1da64d006205db1a2f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.940046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac81a731fca4f1da64d006205db1a2f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.950179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac81a731fca4f1da64d006205db1a2f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.951058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac81a731fca4f1da64d006205db1a2f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.962284 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac81a731fca4f1da64d006205db1a2f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:15.985001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1027/2085] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:15 2022] DELETE /identity/v3/users/2ac81a731fca4f1da64d006205db1a2f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:16.004525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c158aa5c1442fd92a5edf02b2f284a', 'request_id': 'req-178f8815-ba42-49dd-9d86-23ed3fdc25ec'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.010663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c158aa5c1442fd92a5edf02b2f284a', 'request_id': 'req-178f8815-ba42-49dd-9d86-23ed3fdc25ec'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.017435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c158aa5c1442fd92a5edf02b2f284a', 'request_id': 'req-178f8815-ba42-49dd-9d86-23ed3fdc25ec'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.034528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] The token cache is being invalidate because project 66c158aa5c1442fd92a5edf02b2f284a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:16.034832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.036490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.038204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1059/2086] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:15 2022] DELETE /identity/v3/projects/66c158aa5c1442fd92a5edf02b2f284a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:16.042338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:16.043777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:16.074544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:16.139423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32334a3-352a-4fd0-b592-c18fb2804f7a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:16.146104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:16.146837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.149873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.149873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] PATH_INFO: `/v3/users/e3fc36c8a4b6472580733a05002e82a0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.149873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3fc36c8a4b6472580733a05002e82a0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:16.151146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:16.219742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3fc36c8a4b6472580733a05002e82a0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.220853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3fc36c8a4b6472580733a05002e82a0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.231339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3fc36c8a4b6472580733a05002e82a0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.232150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3fc36c8a4b6472580733a05002e82a0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.242357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-222f2e48-98d3-4e95-81ac-f6e2411b8c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3fc36c8a4b6472580733a05002e82a0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.262753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1028/2087] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:16 2022] DELETE /identity/v3/users/e3fc36c8a4b6472580733a05002e82a0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:16.338141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:16.340253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:16.439429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8815-ba42-49dd-9d86-23ed3fdc25ec admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:16.480835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:16.524443 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:16.525051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.525493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.525812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] PATH_INFO: `/v3/projects/b78030b489c14418afa52c5a58f0643d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.529063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78030b489c14418afa52c5a58f0643d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:16.531236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:16.583882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78030b489c14418afa52c5a58f0643d', 'request_id': 'req-d701c706-64c3-4f4e-b650-f4e53de58398'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.590035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78030b489c14418afa52c5a58f0643d', 'request_id': 'req-d701c706-64c3-4f4e-b650-f4e53de58398'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.595916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78030b489c14418afa52c5a58f0643d', 'request_id': 'req-d701c706-64c3-4f4e-b650-f4e53de58398'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.609618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] The token cache is being invalidate because project b78030b489c14418afa52c5a58f0643d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:16.610002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.610665 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d701c706-64c3-4f4e-b650-f4e53de58398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.612177 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1060/2088] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:16 2022] DELETE /identity/v3/projects/b78030b489c14418afa52c5a58f0643d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:16.617423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60cc49-5e2a-4e63-8e30-3041947fe89f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.617758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60cc49-5e2a-4e63-8e30-3041947fe89f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.618046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60cc49-5e2a-4e63-8e30-3041947fe89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.638735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3a60cc49-5e2a-4e63-8e30-3041947fe89f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:16.639943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3a60cc49-5e2a-4e63-8e30-3041947fe89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:16.705799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1029/2089] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:16.715159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37d61-7661-4907-a645-4c5723b9fb6b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.715688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37d61-7661-4907-a645-4c5723b9fb6b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.715688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37d61-7661-4907-a645-4c5723b9fb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.741956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b7f37d61-7661-4907-a645-4c5723b9fb6b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:16.743641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b7f37d61-7661-4907-a645-4c5723b9fb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:16.748362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60cc49-5e2a-4e63-8e30-3041947fe89f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:16.749799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3a60cc49-5e2a-4e63-8e30-3041947fe89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:16.756997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1061/2090] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:16.759032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37d61-7661-4907-a645-4c5723b9fb6b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:16.773652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37d61-7661-4907-a645-4c5723b9fb6b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:16.775434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60cc49-5e2a-4e63-8e30-3041947fe89f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:16.779678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:16.780651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.782441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.782441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.782441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:16.784376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:16.785244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:16.786310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:16.786418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.786759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.787040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] PATH_INFO: `/v3/projects/444bd68c44d0483483893c4dcb210616` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.788493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444bd68c44d0483483893c4dcb210616)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:16.790764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:16.799724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1062/2091] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:50:16.804864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:16.816263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066cf5-4f86-4aba-8bfb-375f0e45c332 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:16.828111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25300-a2e7-4c97-89a9-ecdbffefdb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:16.829447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25300-a2e7-4c97-89a9-ecdbffefdb30 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.833284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25300-a2e7-4c97-89a9-ecdbffefdb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.833589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d25300-a2e7-4c97-89a9-ecdbffefdb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.834396 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d25300-a2e7-4c97-89a9-ecdbffefdb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:16.836536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d25300-a2e7-4c97-89a9-ecdbffefdb30 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:16.844197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:16.857126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444bd68c44d0483483893c4dcb210616', 'request_id': 'req-d0b4452f-98df-41d1-a301-169743fc4a71'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.864388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444bd68c44d0483483893c4dcb210616', 'request_id': 'req-d0b4452f-98df-41d1-a301-169743fc4a71'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.872280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1063/2092] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:16 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:16.873501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444bd68c44d0483483893c4dcb210616', 'request_id': 'req-d0b4452f-98df-41d1-a301-169743fc4a71'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.883631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25300-a2e7-4c97-89a9-ecdbffefdb30 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:16.892950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] The token cache is being invalidate because project 444bd68c44d0483483893c4dcb210616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:16.893440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.894381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d0b4452f-98df-41d1-a301-169743fc4a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:16.897333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1030/2093] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:16 2022] DELETE /identity/v3/projects/444bd68c44d0483483893c4dcb210616 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:16.904869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dabe9-3cd3-41a6-b1bc-cfff21dd5ef5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.905121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dabe9-3cd3-41a6-b1bc-cfff21dd5ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.905547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dabe9-3cd3-41a6-b1bc-cfff21dd5ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.932186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9b9dabe9-3cd3-41a6-b1bc-cfff21dd5ef5 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:16.933436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9b9dabe9-3cd3-41a6-b1bc-cfff21dd5ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:16.976376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d25300-a2e7-4c97-89a9-ecdbffefdb30 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:16.982168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:16.983379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:16.983379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:16.984392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:16.985125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:16.987568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.020070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1064/2094] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:16 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:17.021200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.025887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.054858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a0afd-5e73-42db-a1fe-0618a7580cc1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.061816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1031/2095] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:17.061816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dabe9-3cd3-41a6-b1bc-cfff21dd5ef5 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.061816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9b9dabe9-3cd3-41a6-b1bc-cfff21dd5ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.073355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43674a40-15d7-44bc-9b1f-45b3779f3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.074185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43674a40-15d7-44bc-9b1f-45b3779f3cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.074478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43674a40-15d7-44bc-9b1f-45b3779f3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.074749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43674a40-15d7-44bc-9b1f-45b3779f3cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.075946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dabe9-3cd3-41a6-b1bc-cfff21dd5ef5 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.076114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43674a40-15d7-44bc-9b1f-45b3779f3cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.077694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43674a40-15d7-44bc-9b1f-45b3779f3cc9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.080612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:17.081583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.082354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.082728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.083070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] PATH_INFO: `/v3/users/e1080fc101c84889965c03c102fe12b4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.084328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1080fc101c84889965c03c102fe12b4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.087201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.101626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1065/2096] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:17.103073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d550fc4-ca97-4a98-9ad0-cb51f83a5304 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.103367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d550fc4-ca97-4a98-9ad0-cb51f83a5304 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.103647 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d550fc4-ca97-4a98-9ad0-cb51f83a5304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.135090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5d550fc4-ca97-4a98-9ad0-cb51f83a5304 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:17.136332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5d550fc4-ca97-4a98-9ad0-cb51f83a5304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.145531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1066/2097] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:17.146732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d550fc4-ca97-4a98-9ad0-cb51f83a5304 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.148982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1080fc101c84889965c03c102fe12b4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:17.149722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1080fc101c84889965c03c102fe12b4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:17.161357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1080fc101c84889965c03c102fe12b4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:17.162061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1080fc101c84889965c03c102fe12b4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:17.163285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d550fc4-ca97-4a98-9ad0-cb51f83a5304 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.168233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.168738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.169022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.169360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.169983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.173460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1080fc101c84889965c03c102fe12b4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:17.174064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.187267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1067/2098] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:17.188133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.190545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.198349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1032/2099] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:17 2022] DELETE /identity/v3/users/e1080fc101c84889965c03c102fe12b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:17.201467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.201467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.207942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209390d3-daf6-4b29-a887-7c2fd158ff51 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.245671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:17.274925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca192de-37fd-4541-be38-baa89bda441c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.279991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bbebb-1a16-419e-aa3f-f32a4a5187a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.280604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbebb-1a16-419e-aa3f-f32a4a5187a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.280884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbebb-1a16-419e-aa3f-f32a4a5187a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.281155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bbebb-1a16-419e-aa3f-f32a4a5187a4 admin admin] PATH_INFO: `/v3/projects/889297db69ac43419a36fd7aa88b6c7b/users/e6e12bc5cd464c43a2d3869b3b3d9853/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.287868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a70f4f-3def-4fb3-8f66-b62f24ce70f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.288510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a70f4f-3def-4fb3-8f66-b62f24ce70f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.288792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a70f4f-3def-4fb3-8f66-b62f24ce70f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.289064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a70f4f-3def-4fb3-8f66-b62f24ce70f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.289755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a70f4f-3def-4fb3-8f66-b62f24ce70f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:17.290062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a70f4f-3def-4fb3-8f66-b62f24ce70f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.291659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a70f4f-3def-4fb3-8f66-b62f24ce70f6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.297961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bbebb-1a16-419e-aa3f-f32a4a5187a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889297db69ac43419a36fd7aa88b6c7b, user_id=e6e12bc5cd464c43a2d3869b3b3d9853, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.300621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bbebb-1a16-419e-aa3f-f32a4a5187a4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.305245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1068/2100] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:17.306393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99774-14c0-4cce-9afb-2d9abac21ae6 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.306741 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99774-14c0-4cce-9afb-2d9abac21ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.307033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f99774-14c0-4cce-9afb-2d9abac21ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.318832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1033/2101] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:17 2022] PUT /identity/v3/projects/889297db69ac43419a36fd7aa88b6c7b/users/e6e12bc5cd464c43a2d3869b3b3d9853/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:17.326759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bbebb-1a16-419e-aa3f-f32a4a5187a4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.330523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-93f99774-14c0-4cce-9afb-2d9abac21ae6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:17.331752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-93f99774-14c0-4cce-9afb-2d9abac21ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.395759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bbebb-1a16-419e-aa3f-f32a4a5187a4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.400486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.401055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1069/2102] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:17.401166 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.401398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.401661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.402300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.402434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909df7-0aa6-4e42-888e-f579feb2e620 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.403209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909df7-0aa6-4e42-888e-f579feb2e620 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.403209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909df7-0aa6-4e42-888e-f579feb2e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.404829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.435671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bf909df7-0aa6-4e42-888e-f579feb2e620 None None] MFA Rules not processed for user `e6e12bc5cd464c43a2d3869b3b3d9853`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:17.437087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bf909df7-0aa6-4e42-888e-f579feb2e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.444672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1034/2103] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:17 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:17.444672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.444917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.504514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9feca2-83f1-4dd7-b375-5efeac7149e6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.506859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1070/2104] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:17.508763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a8824-413c-45ed-91cb-e716d170b1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.509376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8824-413c-45ed-91cb-e716d170b1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.509691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8824-413c-45ed-91cb-e716d170b1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.509968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8824-413c-45ed-91cb-e716d170b1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.511340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf909df7-0aa6-4e42-888e-f579feb2e620 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.518226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:17.523308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf909df7-0aa6-4e42-888e-f579feb2e620 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.568314 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:17.572640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a8824-413c-45ed-91cb-e716d170b1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.573532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a8824-413c-45ed-91cb-e716d170b1a0 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.583456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0625fbd-44da-4291-9f52-8e7fd4af13f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.584087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0625fbd-44da-4291-9f52-8e7fd4af13f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.584373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0625fbd-44da-4291-9f52-8e7fd4af13f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.584644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0625fbd-44da-4291-9f52-8e7fd4af13f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.585288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0625fbd-44da-4291-9f52-8e7fd4af13f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.587276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0625fbd-44da-4291-9f52-8e7fd4af13f1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.588915 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1035/2105] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:17.590458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a8824-413c-45ed-91cb-e716d170b1a0 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.607466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a8824-413c-45ed-91cb-e716d170b1a0 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.612853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa8c8d-edd8-4734-b60f-1c0c78f43865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.613749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa8c8d-edd8-4734-b60f-1c0c78f43865 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.614124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa8c8d-edd8-4734-b60f-1c0c78f43865 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.614472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa8c8d-edd8-4734-b60f-1c0c78f43865 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.615213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa8c8d-edd8-4734-b60f-1c0c78f43865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.617194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa8c8d-edd8-4734-b60f-1c0c78f43865 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.623595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1071/2106] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:17 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:17.627600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0625fbd-44da-4291-9f52-8e7fd4af13f1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.641097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0625fbd-44da-4291-9f52-8e7fd4af13f1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.647448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f8259-697d-4e94-a4c0-0fc457454438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.648068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8259-697d-4e94-a4c0-0fc457454438 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.648351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8259-697d-4e94-a4c0-0fc457454438 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.648452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1036/2107] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:17 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:17.648627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f8259-697d-4e94-a4c0-0fc457454438 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.649279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f8259-697d-4e94-a4c0-0fc457454438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.650935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f8259-697d-4e94-a4c0-0fc457454438 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.652678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa8c8d-edd8-4734-b60f-1c0c78f43865 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.663308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1072/2108] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:17.669229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f8259-697d-4e94-a4c0-0fc457454438 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.680885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f8259-697d-4e94-a4c0-0fc457454438 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.731544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa8c8d-edd8-4734-b60f-1c0c78f43865 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.736609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1dea3-caf8-4236-aa84-09c7681ed3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.737229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1dea3-caf8-4236-aa84-09c7681ed3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.737511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1dea3-caf8-4236-aa84-09c7681ed3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.737811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1dea3-caf8-4236-aa84-09c7681ed3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.738445 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1dea3-caf8-4236-aa84-09c7681ed3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.740417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1dea3-caf8-4236-aa84-09c7681ed3b6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.747597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111f08-938c-4721-8883-9f7826fdc205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.748794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111f08-938c-4721-8883-9f7826fdc205 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.749079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111f08-938c-4721-8883-9f7826fdc205 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.749355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111f08-938c-4721-8883-9f7826fdc205 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.750308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21111f08-938c-4721-8883-9f7826fdc205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.752293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21111f08-938c-4721-8883-9f7826fdc205 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.767734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1037/2109] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:17 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:17.771337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1073/2110] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:17.774439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1dea3-caf8-4236-aa84-09c7681ed3b6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.774842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111f08-938c-4721-8883-9f7826fdc205 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.785382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1dea3-caf8-4236-aa84-09c7681ed3b6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.786678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111f08-938c-4721-8883-9f7826fdc205 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.792976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa09ccf-86a1-4616-bb3c-e0a8018ca70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.793711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09ccf-86a1-4616-bb3c-e0a8018ca70a admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.793977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09ccf-86a1-4616-bb3c-e0a8018ca70a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.794657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09ccf-86a1-4616-bb3c-e0a8018ca70a admin admin] PATH_INFO: `/v3/projects/ff61cb2e5818416bad33f77a05afb95b/users/ba954df80f1c4e9b80ead40c1d334930/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.798096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606c4ca-d25f-4e59-a580-2c04f2439a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.798720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606c4ca-d25f-4e59-a580-2c04f2439a6f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.799005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606c4ca-d25f-4e59-a580-2c04f2439a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.799280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606c4ca-d25f-4e59-a580-2c04f2439a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.799928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606c4ca-d25f-4e59-a580-2c04f2439a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.803053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606c4ca-d25f-4e59-a580-2c04f2439a6f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.813372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa09ccf-86a1-4616-bb3c-e0a8018ca70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff61cb2e5818416bad33f77a05afb95b, user_id=ba954df80f1c4e9b80ead40c1d334930, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.815526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1038/2111] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:17.819725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606c4ca-d25f-4e59-a580-2c04f2439a6f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.819855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa09ccf-86a1-4616-bb3c-e0a8018ca70a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.830881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606c4ca-d25f-4e59-a580-2c04f2439a6f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.843374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1074/2112] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:17 2022] PUT /identity/v3/projects/ff61cb2e5818416bad33f77a05afb95b/users/ba954df80f1c4e9b80ead40c1d334930/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:17.853629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3566-c51c-4a6b-ba6e-dc31959113f2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.854075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3566-c51c-4a6b-ba6e-dc31959113f2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.854395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3566-c51c-4a6b-ba6e-dc31959113f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.906735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7e8b3566-c51c-4a6b-ba6e-dc31959113f2 None None] MFA Rules not processed for user `ba954df80f1c4e9b80ead40c1d334930`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:17.908043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7e8b3566-c51c-4a6b-ba6e-dc31959113f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.913676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.914311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.914624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.915247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.915753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.917555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.945426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1039/2113] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:17.950205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:17.952128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:17.969780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e215a-27fd-40ef-b1af-2d25fccf00bf admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:17.976564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:17.977241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:17.977528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:17.977766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] PATH_INFO: `/v3/projects/1cfe901474c5401e94f48040c53d062f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:17.979096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cfe901474c5401e94f48040c53d062f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:17.982052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:17.993378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:18.018111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1075/2114] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:18.021337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b3566-c51c-4a6b-ba6e-dc31959113f2 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.030540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:18.033776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b3566-c51c-4a6b-ba6e-dc31959113f2 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.039610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cfe901474c5401e94f48040c53d062f', 'request_id': 'req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.045545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cfe901474c5401e94f48040c53d062f', 'request_id': 'req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.054574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cfe901474c5401e94f48040c53d062f', 'request_id': 'req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.073814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] The token cache is being invalidate because project 1cfe901474c5401e94f48040c53d062f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:18.073814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.074600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.076496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1040/2115] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:17 2022] DELETE /identity/v3/projects/1cfe901474c5401e94f48040c53d062f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:18.077895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.079707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:18.181220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.182030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.184463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.184463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] PATH_INFO: `/v3/projects/d2c6a4c2f2fa46238f77ae18e2a2528d/users/c2fe1704fd55458eae94912d98ba0178/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.214392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c6a4c2f2fa46238f77ae18e2a2528d, user_id=c2fe1704fd55458eae94912d98ba0178, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.218338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.219313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db3a6f-6e61-426b-aec1-1e5ea8e1bab4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.227906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c8cf3-5e75-4b0c-b491-765270ef8815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.228679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c8cf3-5e75-4b0c-b491-765270ef8815 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.229043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c8cf3-5e75-4b0c-b491-765270ef8815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.229451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c8cf3-5e75-4b0c-b491-765270ef8815 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.230687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c8cf3-5e75-4b0c-b491-765270ef8815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.232731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c8cf3-5e75-4b0c-b491-765270ef8815 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.237810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1076/2116] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:18 2022] PUT /identity/v3/projects/d2c6a4c2f2fa46238f77ae18e2a2528d/users/c2fe1704fd55458eae94912d98ba0178/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:18.239574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.241474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:18.307959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1041/2117] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:18 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:18.312623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380399-adb0-4123-aba9-950474698eff None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.312912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380399-adb0-4123-aba9-950474698eff None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.313186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a380399-adb0-4123-aba9-950474698eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.356071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be095198-073f-48cb-ba24-fe53c7519ae7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.385511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4a380399-adb0-4123-aba9-950474698eff None None] MFA Rules not processed for user `c2fe1704fd55458eae94912d98ba0178`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:18.386804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4a380399-adb0-4123-aba9-950474698eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:18.484862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.485889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.486949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.487427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] PATH_INFO: `/v3/users/cce93893b6b14bf7b6a6d4ac3566d0ad` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.489481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce93893b6b14bf7b6a6d4ac3566d0ad)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.495681 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.508503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1042/2118] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:18.509528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a380399-adb0-4123-aba9-950474698eff None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.520724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:18.521529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a380399-adb0-4123-aba9-950474698eff None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.526410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.527106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.527353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.527756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.528449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.530532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.559576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1043/2119] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:18 2022] POST /identity/v3/users => generated 291 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:18.559576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.562163 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:18.569770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce93893b6b14bf7b6a6d4ac3566d0ad'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.570578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce93893b6b14bf7b6a6d4ac3566d0ad'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.576156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54075121-da1b-413a-a904-9aa153f0d26e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.578444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce93893b6b14bf7b6a6d4ac3566d0ad'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.579643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce93893b6b14bf7b6a6d4ac3566d0ad'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.581450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.582377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.582640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.582879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.583458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.585528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.595522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce93893b6b14bf7b6a6d4ac3566d0ad'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:18.614814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1077/2120] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:18 2022] DELETE /identity/v3/users/cce93893b6b14bf7b6a6d4ac3566d0ad => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:18.616106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.617532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:18.620019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1044/2121] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:18 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:18.624020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.626186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:18.633052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:18.705238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bd47b-e23e-4b06-9d47-025169e88f30 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.705984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711349e9-5342-4571-af7c-93fa581b6301 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.710757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f545c5-6f81-4750-83e8-39bae1fcffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.711156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911175-a621-46f5-b1a0-ddc85346f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.711743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f545c5-6f81-4750-83e8-39bae1fcffc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.711874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f545c5-6f81-4750-83e8-39bae1fcffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.711965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911175-a621-46f5-b1a0-ddc85346f91b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.712513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f545c5-6f81-4750-83e8-39bae1fcffc7 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.712640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911175-a621-46f5-b1a0-ddc85346f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.712916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911175-a621-46f5-b1a0-ddc85346f91b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.713015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f545c5-6f81-4750-83e8-39bae1fcffc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.713893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba911175-a621-46f5-b1a0-ddc85346f91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.715140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f545c5-6f81-4750-83e8-39bae1fcffc7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.715687 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba911175-a621-46f5-b1a0-ddc85346f91b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.728420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1078/2122] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:18.732828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911175-a621-46f5-b1a0-ddc85346f91b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.746690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911175-a621-46f5-b1a0-ddc85346f91b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.751351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1045/2123] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:18 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:18.755474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f545c5-6f81-4750-83e8-39bae1fcffc7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.756730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d905a2-874f-483e-a6dd-295ee3d62c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.757536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d905a2-874f-483e-a6dd-295ee3d62c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.757853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d905a2-874f-483e-a6dd-295ee3d62c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.758125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d905a2-874f-483e-a6dd-295ee3d62c72 admin admin] PATH_INFO: `/v3/projects/6f3a97f1b9644dc9ab82f86514d89ad6/users/ecdfe9ac05554e32aaf862541d199601/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.770225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f545c5-6f81-4750-83e8-39bae1fcffc7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.775162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfbdcd-4aa4-4bda-97c2-f25dee48b710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.775980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfbdcd-4aa4-4bda-97c2-f25dee48b710 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.776750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfbdcd-4aa4-4bda-97c2-f25dee48b710 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.777048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfbdcd-4aa4-4bda-97c2-f25dee48b710 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.777898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfbdcd-4aa4-4bda-97c2-f25dee48b710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.779614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfbdcd-4aa4-4bda-97c2-f25dee48b710 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.780839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d905a2-874f-483e-a6dd-295ee3d62c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3a97f1b9644dc9ab82f86514d89ad6, user_id=ecdfe9ac05554e32aaf862541d199601, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.784514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d905a2-874f-483e-a6dd-295ee3d62c72 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.802010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1046/2124] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:18.804133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfbdcd-4aa4-4bda-97c2-f25dee48b710 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.806347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1079/2125] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:18 2022] PUT /identity/v3/projects/6f3a97f1b9644dc9ab82f86514d89ad6/users/ecdfe9ac05554e32aaf862541d199601/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:18.810538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d905a2-874f-483e-a6dd-295ee3d62c72 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.815901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfbdcd-4aa4-4bda-97c2-f25dee48b710 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.881454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd29a-32b2-4e76-8521-01ee480c467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.882415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd29a-32b2-4e76-8521-01ee480c467b admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.883031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd29a-32b2-4e76-8521-01ee480c467b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.883497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbd29a-32b2-4e76-8521-01ee480c467b admin admin] PATH_INFO: `/v3/projects/069570a26b8843d194fc63f8f3673728/users/33599fc21fee4f23a2fb3257b600c416/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.891432 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d905a2-874f-483e-a6dd-295ee3d62c72 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.893958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254151b7-d975-46bc-bd2b-98cefa635821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:18.894583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254151b7-d975-46bc-bd2b-98cefa635821 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:18.895470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254151b7-d975-46bc-bd2b-98cefa635821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:18.895746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254151b7-d975-46bc-bd2b-98cefa635821 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:18.896400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254151b7-d975-46bc-bd2b-98cefa635821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.898293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254151b7-d975-46bc-bd2b-98cefa635821 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.904671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbd29a-32b2-4e76-8521-01ee480c467b admin admin] RBAC: Authorizing `identity:create_grant(project_id=069570a26b8843d194fc63f8f3673728, user_id=33599fc21fee4f23a2fb3257b600c416, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:18.909819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbd29a-32b2-4e76-8521-01ee480c467b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:18.916044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1080/2126] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:18.920475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254151b7-d975-46bc-bd2b-98cefa635821 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:18.926065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:18.927753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1047/2127] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:18 2022] PUT /identity/v3/projects/069570a26b8843d194fc63f8f3673728/users/33599fc21fee4f23a2fb3257b600c416/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:18.931660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254151b7-d975-46bc-bd2b-98cefa635821 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:18.931975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd29a-32b2-4e76-8521-01ee480c467b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.010541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbd29a-32b2-4e76-8521-01ee480c467b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.015710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c303f1a-f99c-4c5d-89db-865d7e1e065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.016367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c303f1a-f99c-4c5d-89db-865d7e1e065c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.016812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c303f1a-f99c-4c5d-89db-865d7e1e065c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.017088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c303f1a-f99c-4c5d-89db-865d7e1e065c admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.018127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c303f1a-f99c-4c5d-89db-865d7e1e065c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.020413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c303f1a-f99c-4c5d-89db-865d7e1e065c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.036538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1048/2128] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:19.038471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c303f1a-f99c-4c5d-89db-865d7e1e065c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.042103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.042785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.043075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.043356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] PATH_INFO: `/v3/projects/6f3a97f1b9644dc9ab82f86514d89ad6/users/ecdfe9ac05554e32aaf862541d199601/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.044304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:19.045924 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3a97f1b9644dc9ab82f86514d89ad6, user_id=ecdfe9ac05554e32aaf862541d199601, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.049118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.050655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c303f1a-f99c-4c5d-89db-865d7e1e065c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.058909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e825220-54c6-44a2-9798-0fe768b14ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.060029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825220-54c6-44a2-9798-0fe768b14ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.060426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825220-54c6-44a2-9798-0fe768b14ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.060822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e825220-54c6-44a2-9798-0fe768b14ce0 admin admin] PATH_INFO: `/v3/projects/069570a26b8843d194fc63f8f3673728/users/33599fc21fee4f23a2fb3257b600c416/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.063614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e825220-54c6-44a2-9798-0fe768b14ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069570a26b8843d194fc63f8f3673728, user_id=33599fc21fee4f23a2fb3257b600c416, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.065624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1081/2129] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:18 2022] PUT /identity/v3/projects/6f3a97f1b9644dc9ab82f86514d89ad6/users/ecdfe9ac05554e32aaf862541d199601/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:19.066518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.067113 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e825220-54c6-44a2-9798-0fe768b14ce0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.069496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.090287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1049/2130] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:19 2022] PUT /identity/v3/projects/069570a26b8843d194fc63f8f3673728/users/33599fc21fee4f23a2fb3257b600c416/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:19.090287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b157c-d408-448c-92c2-003e4850cfdf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.090287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b157c-d408-448c-92c2-003e4850cfdf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.090287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b157c-d408-448c-92c2-003e4850cfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.116770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b19b157c-d408-448c-92c2-003e4850cfdf None None] MFA Rules not processed for user `ecdfe9ac05554e32aaf862541d199601`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:19.118246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b19b157c-d408-448c-92c2-003e4850cfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.158772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaacee7-ffcd-4639-bda6-3916406c882d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.202583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1050/2131] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:19.204684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d8bf-e838-4735-b45a-d31cf18f66be None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.204981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d8bf-e838-4735-b45a-d31cf18f66be None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.205434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3d8bf-e838-4735-b45a-d31cf18f66be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.222589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.223830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.224109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.224382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] PATH_INFO: `/v3/projects/8094c302114e46ea92136ca20f295210` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.225559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8094c302114e46ea92136ca20f295210)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.227673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.236595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-51e3d8bf-e838-4735-b45a-d31cf18f66be None None] MFA Rules not processed for user `33599fc21fee4f23a2fb3257b600c416`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:19.237855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-51e3d8bf-e838-4735-b45a-d31cf18f66be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.278583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:19.279566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8094c302114e46ea92136ca20f295210', 'request_id': 'req-beeaa813-890f-4bc6-8d21-91741cc504b5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:19.288069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8094c302114e46ea92136ca20f295210', 'request_id': 'req-beeaa813-890f-4bc6-8d21-91741cc504b5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:19.295933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8094c302114e46ea92136ca20f295210', 'request_id': 'req-beeaa813-890f-4bc6-8d21-91741cc504b5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:19.311293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] The token cache is being invalidate because project 8094c302114e46ea92136ca20f295210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:19.311587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:19.312411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:19.318289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1082/2132] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:19 2022] DELETE /identity/v3/projects/8094c302114e46ea92136ca20f295210 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:19.318289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.318289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.327736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1051/2133] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:19.327736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58606f1c-afe8-4d92-b35c-5c3d93ef1406 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.327736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58606f1c-afe8-4d92-b35c-5c3d93ef1406 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.327736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58606f1c-afe8-4d92-b35c-5c3d93ef1406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.346417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-58606f1c-afe8-4d92-b35c-5c3d93ef1406 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:19.347548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-58606f1c-afe8-4d92-b35c-5c3d93ef1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.380174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaa813-890f-4bc6-8d21-91741cc504b5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.385587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5f9e-1547-4b2e-9621-a1e2a0b9ce6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.386393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5f9e-1547-4b2e-9621-a1e2a0b9ce6a service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.386806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5f9e-1547-4b2e-9621-a1e2a0b9ce6a service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.387180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5f9e-1547-4b2e-9621-a1e2a0b9ce6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.388996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e28c5f9e-1547-4b2e-9621-a1e2a0b9ce6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.401086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:19.413642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1052/2134] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:19.414194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58606f1c-afe8-4d92-b35c-5c3d93ef1406 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.415726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-58606f1c-afe8-4d92-b35c-5c3d93ef1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.429275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58606f1c-afe8-4d92-b35c-5c3d93ef1406 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.433261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.433936 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.434218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.434514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.436325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.461722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c5f9e-1547-4b2e-9621-a1e2a0b9ce6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.463199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c5f9e-1547-4b2e-9621-a1e2a0b9ce6a service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.473252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1083/2135] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:19.474673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7683a38-a2f2-42de-b91b-207198ae7b57 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.475276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7683a38-a2f2-42de-b91b-207198ae7b57 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.475558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7683a38-a2f2-42de-b91b-207198ae7b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.502489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a7683a38-a2f2-42de-b91b-207198ae7b57 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:19.503710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a7683a38-a2f2-42de-b91b-207198ae7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.504029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.506477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.524103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1084/2136] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:19.524412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1053/2137] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:19.525269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7683a38-a2f2-42de-b91b-207198ae7b57 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.535037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.539553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7683a38-a2f2-42de-b91b-207198ae7b57 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.544340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.544954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.545233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.545501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.546197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:19.546671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.547884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f8b49-3477-4cd2-9fbd-e56e4142fe85 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.548290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.552697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.553586 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.554233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.554713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.557363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:19.565249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1085/2138] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:19.566444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.577988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1014d4-e479-4c8f-bfd9-7bad7166e45e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.584193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd3207-8a88-4234-877c-4ebcd338a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.584415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3207-8a88-4234-877c-4ebcd338a78b admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.584697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3207-8a88-4234-877c-4ebcd338a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.584970 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd3207-8a88-4234-877c-4ebcd338a78b admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.585621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd3207-8a88-4234-877c-4ebcd338a78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.588299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd3207-8a88-4234-877c-4ebcd338a78b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.638279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.640004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.640186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1086/2139] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:19 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:19.644601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd3207-8a88-4234-877c-4ebcd338a78b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.653861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1054/2140] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:19.712588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:19.734085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd3207-8a88-4234-877c-4ebcd338a78b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.740276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8472-a71f-49bf-8b28-483da6c85e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.741055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8472-a71f-49bf-8b28-483da6c85e08 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.741397 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8472-a71f-49bf-8b28-483da6c85e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.741764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c8472-a71f-49bf-8b28-483da6c85e08 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.742598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c8472-a71f-49bf-8b28-483da6c85e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.744634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c8472-a71f-49bf-8b28-483da6c85e08 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.780694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1087/2141] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:19 2022] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:19.784894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.797504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31a7ef-93a0-43e2-8e1a-ee425d91fd8a service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.804510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b36a73-8cfc-4607-9b8c-df45ffe3238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.805141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b36a73-8cfc-4607-9b8c-df45ffe3238d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.805427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b36a73-8cfc-4607-9b8c-df45ffe3238d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.805743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b36a73-8cfc-4607-9b8c-df45ffe3238d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.806409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b36a73-8cfc-4607-9b8c-df45ffe3238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.808243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b36a73-8cfc-4607-9b8c-df45ffe3238d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.845299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1055/2142] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:19.849237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8472-a71f-49bf-8b28-483da6c85e08 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.862029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c8472-a71f-49bf-8b28-483da6c85e08 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.869192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be45162-4cf0-499a-8654-3338af4b9c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.869940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45162-4cf0-499a-8654-3338af4b9c61 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.870278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45162-4cf0-499a-8654-3338af4b9c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.870646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be45162-4cf0-499a-8654-3338af4b9c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.871404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be45162-4cf0-499a-8654-3338af4b9c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.873421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be45162-4cf0-499a-8654-3338af4b9c61 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.906884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1088/2143] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:19.907866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b36a73-8cfc-4607-9b8c-df45ffe3238d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:19.923155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b36a73-8cfc-4607-9b8c-df45ffe3238d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:19.929442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d4eaf-bc34-44f3-9296-fb69c0bd96a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:19.930448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d4eaf-bc34-44f3-9296-fb69c0bd96a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:19.930825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d4eaf-bc34-44f3-9296-fb69c0bd96a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:19.931223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d4eaf-bc34-44f3-9296-fb69c0bd96a0 admin admin] PATH_INFO: `/v3/projects/a85e57e9d65345ac8b5feb7546441d71/users/cd2da74eb4614fe0bd6dceaf75e76a49/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:19.974027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d4eaf-bc34-44f3-9296-fb69c0bd96a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85e57e9d65345ac8b5feb7546441d71, user_id=cd2da74eb4614fe0bd6dceaf75e76a49, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:19.976962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d4eaf-bc34-44f3-9296-fb69c0bd96a0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:19.998612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1056/2144] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:19 2022] PUT /identity/v3/projects/a85e57e9d65345ac8b5feb7546441d71/users/cd2da74eb4614fe0bd6dceaf75e76a49/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:20.010253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c230b6-91f9-4043-b2ef-2f8e1573871c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.010583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c230b6-91f9-4043-b2ef-2f8e1573871c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.010908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c230b6-91f9-4043-b2ef-2f8e1573871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.062039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a6c230b6-91f9-4043-b2ef-2f8e1573871c None None] MFA Rules not processed for user `cd2da74eb4614fe0bd6dceaf75e76a49`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:20.063401 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a6c230b6-91f9-4043-b2ef-2f8e1573871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:20.155322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1089/2145] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:20.159858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d4eaf-bc34-44f3-9296-fb69c0bd96a0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:20.228724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d4eaf-bc34-44f3-9296-fb69c0bd96a0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:20.234046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940bf34-4a06-455d-8594-290823217346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:20.234664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940bf34-4a06-455d-8594-290823217346 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.234949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940bf34-4a06-455d-8594-290823217346 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.235227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940bf34-4a06-455d-8594-290823217346 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.235885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940bf34-4a06-455d-8594-290823217346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:20.237871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940bf34-4a06-455d-8594-290823217346 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:20.244746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:20.273364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1057/2146] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:20 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:20.277807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c230b6-91f9-4043-b2ef-2f8e1573871c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:20.290506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c230b6-91f9-4043-b2ef-2f8e1573871c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:20.353719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4432-f952-4191-80c3-bf1e2824fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:20.354341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4432-f952-4191-80c3-bf1e2824fd07 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.354628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4432-f952-4191-80c3-bf1e2824fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.354902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4432-f952-4191-80c3-bf1e2824fd07 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.355543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f4432-f952-4191-80c3-bf1e2824fd07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:20.357477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f4432-f952-4191-80c3-bf1e2824fd07 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:20.379237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1090/2147] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:20 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:20.384018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940bf34-4a06-455d-8594-290823217346 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:20.397056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940bf34-4a06-455d-8594-290823217346 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:20.401758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cecdba-f338-4be5-99c9-5343992367db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:20.402365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cecdba-f338-4be5-99c9-5343992367db admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.402648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cecdba-f338-4be5-99c9-5343992367db admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.402919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cecdba-f338-4be5-99c9-5343992367db admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.403560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cecdba-f338-4be5-99c9-5343992367db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:20.405159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cecdba-f338-4be5-99c9-5343992367db admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:20.418286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1058/2148] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:20.422624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4432-f952-4191-80c3-bf1e2824fd07 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:20.436013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4432-f952-4191-80c3-bf1e2824fd07 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:20.441021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb686ef-90e1-4090-bdec-95c16bbba441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:20.441736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb686ef-90e1-4090-bdec-95c16bbba441 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.442018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb686ef-90e1-4090-bdec-95c16bbba441 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.442293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb686ef-90e1-4090-bdec-95c16bbba441 admin admin] PATH_INFO: `/v3/projects/68bdfd692817421689c602e244e09631/users/967eea8d383f4880badda97e899d1e25/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.458208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb686ef-90e1-4090-bdec-95c16bbba441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68bdfd692817421689c602e244e09631, user_id=967eea8d383f4880badda97e899d1e25, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:20.460869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb686ef-90e1-4090-bdec-95c16bbba441 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:20.474291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1091/2149] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:20 2022] PUT /identity/v3/projects/68bdfd692817421689c602e244e09631/users/967eea8d383f4880badda97e899d1e25/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:20.478343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cecdba-f338-4be5-99c9-5343992367db admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:20.488158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cecdba-f338-4be5-99c9-5343992367db admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:20.544448 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80809f36-1b75-4bb7-a313-9e6c5e58ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:20.545125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809f36-1b75-4bb7-a313-9e6c5e58ba1a admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.545409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809f36-1b75-4bb7-a313-9e6c5e58ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.545718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80809f36-1b75-4bb7-a313-9e6c5e58ba1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.546359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80809f36-1b75-4bb7-a313-9e6c5e58ba1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:20.547963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80809f36-1b75-4bb7-a313-9e6c5e58ba1a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:20.558372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1059/2150] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:20.562554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb686ef-90e1-4090-bdec-95c16bbba441 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:20.573437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb686ef-90e1-4090-bdec-95c16bbba441 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:20.578118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05e11-9181-473c-8a4a-ac4ee880a389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:20.578785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05e11-9181-473c-8a4a-ac4ee880a389 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.579067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05e11-9181-473c-8a4a-ac4ee880a389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.579337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e05e11-9181-473c-8a4a-ac4ee880a389 admin admin] PATH_INFO: `/v3/projects/68bdfd692817421689c602e244e09631/users/967eea8d383f4880badda97e899d1e25/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.581279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e05e11-9181-473c-8a4a-ac4ee880a389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68bdfd692817421689c602e244e09631, user_id=967eea8d383f4880badda97e899d1e25, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:20.585040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e05e11-9181-473c-8a4a-ac4ee880a389 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:20.600435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1092/2151] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:20 2022] PUT /identity/v3/projects/68bdfd692817421689c602e244e09631/users/967eea8d383f4880badda97e899d1e25/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:20.612723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe53bb-2e5a-48da-a8e0-3ca4f1615c7e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.613008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe53bb-2e5a-48da-a8e0-3ca4f1615c7e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.613286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe53bb-2e5a-48da-a8e0-3ca4f1615c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.642893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fbfe53bb-2e5a-48da-a8e0-3ca4f1615c7e None None] MFA Rules not processed for user `967eea8d383f4880badda97e899d1e25`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:20.644024 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fbfe53bb-2e5a-48da-a8e0-3ca4f1615c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:20.714783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1060/2152] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:20.726652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05e11-9181-473c-8a4a-ac4ee880a389 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:20.731422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:20.799446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e05e11-9181-473c-8a4a-ac4ee880a389 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:20.803702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fad7fb-8f78-45eb-945f-a0c3d40540e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:20.804322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad7fb-8f78-45eb-945f-a0c3d40540e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.804605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad7fb-8f78-45eb-945f-a0c3d40540e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.804890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fad7fb-8f78-45eb-945f-a0c3d40540e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:20.820068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fad7fb-8f78-45eb-945f-a0c3d40540e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:20.821930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fad7fb-8f78-45eb-945f-a0c3d40540e7 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:20.834108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1093/2153] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:20.925901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe53bb-2e5a-48da-a8e0-3ca4f1615c7e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:20.935274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe53bb-2e5a-48da-a8e0-3ca4f1615c7e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:20.938774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4170bb-da7d-4322-a8c7-d56dc3784501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:20.939373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4170bb-da7d-4322-a8c7-d56dc3784501 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:20.939655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4170bb-da7d-4322-a8c7-d56dc3784501 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:20.939929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4170bb-da7d-4322-a8c7-d56dc3784501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:21.003532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:21.007717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4170bb-da7d-4322-a8c7-d56dc3784501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:21.010106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4170bb-da7d-4322-a8c7-d56dc3784501 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:21.031603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1061/2154] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:21.290325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fad7fb-8f78-45eb-945f-a0c3d40540e7 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:21.299477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fad7fb-8f78-45eb-945f-a0c3d40540e7 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:21.304068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:21.304942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:21.305226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:21.305501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:21.307453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:21.374699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:21.376165 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:21.386257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1094/2155] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:21.990759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4170bb-da7d-4322-a8c7-d56dc3784501 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:22.000230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4170bb-da7d-4322-a8c7-d56dc3784501 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:22.003989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b229-3c4d-453b-88d6-fada062e0ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:22.004592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b229-3c4d-453b-88d6-fada062e0ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:22.004874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b229-3c4d-453b-88d6-fada062e0ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:22.005548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b229-3c4d-453b-88d6-fada062e0ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:22.006967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e1d6b229-3c4d-453b-88d6-fada062e0ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:22.074008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6b229-3c4d-453b-88d6-fada062e0ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:22.075531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6b229-3c4d-453b-88d6-fada062e0ec1 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:22.092290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1062/2156] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:23.302957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:23.304549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:23.379111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60face50-0b3c-4d1e-b559-1ea16f7155ca service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:23.384286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:23.384993 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:23.385282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:23.385587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] PATH_INFO: `/v3/users/ba954df80f1c4e9b80ead40c1d334930` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:23.386874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba954df80f1c4e9b80ead40c1d334930)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:23.388885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:23.450963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:23.453350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba954df80f1c4e9b80ead40c1d334930'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:23.454151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba954df80f1c4e9b80ead40c1d334930'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:23.468998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba954df80f1c4e9b80ead40c1d334930'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:23.470038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba954df80f1c4e9b80ead40c1d334930'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:23.486838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba954df80f1c4e9b80ead40c1d334930'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:23.504434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1095/2157] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:23 2022] DELETE /identity/v3/users/ba954df80f1c4e9b80ead40c1d334930 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:23.505999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64a50-6792-45f2-9fd7-05be1e9b7d3c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:23.506492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64a50-6792-45f2-9fd7-05be1e9b7d3c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:23.506573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e64a50-6792-45f2-9fd7-05be1e9b7d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:23.547338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-03e64a50-6792-45f2-9fd7-05be1e9b7d3c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:23.550625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-03e64a50-6792-45f2-9fd7-05be1e9b7d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:23.635953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1063/2158] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:23.646220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:23.647648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:23.704717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336474-4809-4e87-b1df-f2a57ba42770 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:23.708831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eac0b-e306-4fdb-9b73-8d46f7fd7add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:23.709436 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eac0b-e306-4fdb-9b73-8d46f7fd7add service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:23.709751 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eac0b-e306-4fdb-9b73-8d46f7fd7add service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:23.710025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eac0b-e306-4fdb-9b73-8d46f7fd7add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:23.718888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eac0b-e306-4fdb-9b73-8d46f7fd7add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:23.720319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eac0b-e306-4fdb-9b73-8d46f7fd7add service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:23.731547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1096/2159] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:24.029910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64a50-6792-45f2-9fd7-05be1e9b7d3c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:24.031557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-03e64a50-6792-45f2-9fd7-05be1e9b7d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:24.044693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e64a50-6792-45f2-9fd7-05be1e9b7d3c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:24.049717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:24.050352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:24.050919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:24.051261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] PATH_INFO: `/v3/projects/ff61cb2e5818416bad33f77a05afb95b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:24.052504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff61cb2e5818416bad33f77a05afb95b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:24.054614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:24.107822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff61cb2e5818416bad33f77a05afb95b', 'request_id': 'req-077c5957-fb99-416a-be7a-1403f50a5999'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.114541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff61cb2e5818416bad33f77a05afb95b', 'request_id': 'req-077c5957-fb99-416a-be7a-1403f50a5999'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.123362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff61cb2e5818416bad33f77a05afb95b', 'request_id': 'req-077c5957-fb99-416a-be7a-1403f50a5999'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.136543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] The token cache is being invalidate because project ff61cb2e5818416bad33f77a05afb95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:24.136776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.137499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.139382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1064/2160] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:24 2022] DELETE /identity/v3/projects/ff61cb2e5818416bad33f77a05afb95b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:24.143156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eac0b-e306-4fdb-9b73-8d46f7fd7add service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:24.153686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eac0b-e306-4fdb-9b73-8d46f7fd7add service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:24.219522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:24.220167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:24.220450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:24.220725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] PATH_INFO: `/v3/users/ecdfe9ac05554e32aaf862541d199601` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:24.222263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecdfe9ac05554e32aaf862541d199601)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:24.224254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:24.279197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecdfe9ac05554e32aaf862541d199601'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.280009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecdfe9ac05554e32aaf862541d199601'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.287885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecdfe9ac05554e32aaf862541d199601'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.288670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecdfe9ac05554e32aaf862541d199601'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.299599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:24.307678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-e4cdbfb3-4153-41c1-984d-81606c73608e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecdfe9ac05554e32aaf862541d199601'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.327238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1097/2161] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:24 2022] DELETE /identity/v3/users/ecdfe9ac05554e32aaf862541d199601 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:24.777070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:24.778740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:24.796216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c5957-fb99-416a-be7a-1403f50a5999 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:24.825874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:24.881694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:24.882462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:24.882735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:24.883070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] PATH_INFO: `/v3/projects/6f3a97f1b9644dc9ab82f86514d89ad6` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:24.884345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3a97f1b9644dc9ab82f86514d89ad6)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:24.886469 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:24.941798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3a97f1b9644dc9ab82f86514d89ad6', 'request_id': 'req-2bd0526a-c239-461b-8aa9-009b2a215707'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.947494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3a97f1b9644dc9ab82f86514d89ad6', 'request_id': 'req-2bd0526a-c239-461b-8aa9-009b2a215707'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.955994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3a97f1b9644dc9ab82f86514d89ad6', 'request_id': 'req-2bd0526a-c239-461b-8aa9-009b2a215707'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.969717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] The token cache is being invalidate because project 6f3a97f1b9644dc9ab82f86514d89ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:24.970043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.970730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-2bd0526a-c239-461b-8aa9-009b2a215707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:24.973668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1065/2162] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:24 2022] DELETE /identity/v3/projects/6f3a97f1b9644dc9ab82f86514d89ad6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:24.977690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cf64c-191c-43e4-8e3d-0aeca2b65195 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:24.977987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cf64c-191c-43e4-8e3d-0aeca2b65195 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:24.978263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cf64c-191c-43e4-8e3d-0aeca2b65195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:24.998300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b81cf64c-191c-43e4-8e3d-0aeca2b65195 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:24.999763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b81cf64c-191c-43e4-8e3d-0aeca2b65195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:25.073758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1098/2163] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:25.074526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2faf0-2d82-4436-83ac-f0b8222fc776 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.074817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2faf0-2d82-4436-83ac-f0b8222fc776 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.075200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2faf0-2d82-4436-83ac-f0b8222fc776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.098749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-57c2faf0-2d82-4436-83ac-f0b8222fc776 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:25.099979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-57c2faf0-2d82-4436-83ac-f0b8222fc776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:25.108061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1066/2164] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:25.112429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cf64c-191c-43e4-8e3d-0aeca2b65195 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.122174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cf64c-191c-43e4-8e3d-0aeca2b65195 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.126839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.127439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.127720 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.128195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.128645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:25.129258 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.130582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.143428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1099/2165] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:25.148892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2faf0-2d82-4436-83ac-f0b8222fc776 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.157987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2faf0-2d82-4436-83ac-f0b8222fc776 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.163280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f27b-eff1-4425-ac63-3dbce0be78cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.163877 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f27b-eff1-4425-ac63-3dbce0be78cb admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.164225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f27b-eff1-4425-ac63-3dbce0be78cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.164491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506f27b-eff1-4425-ac63-3dbce0be78cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.165127 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506f27b-eff1-4425-ac63-3dbce0be78cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.167142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506f27b-eff1-4425-ac63-3dbce0be78cb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.196758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1067/2166] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:25 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:25.202062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.211849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae3fd2-a3f4-49e8-8d65-0df0a07af5cd admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.288283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e601-99e5-4cf5-a82d-aec4f0738477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.288811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e601-99e5-4cf5-a82d-aec4f0738477 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.289094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e601-99e5-4cf5-a82d-aec4f0738477 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.289371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e601-99e5-4cf5-a82d-aec4f0738477 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.290043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e601-99e5-4cf5-a82d-aec4f0738477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.292544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e601-99e5-4cf5-a82d-aec4f0738477 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.316569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1100/2167] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:25 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:25.320948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f27b-eff1-4425-ac63-3dbce0be78cb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.331587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506f27b-eff1-4425-ac63-3dbce0be78cb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.336314 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893fec1-a3cb-4c1b-b493-548e763ea098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.336924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893fec1-a3cb-4c1b-b493-548e763ea098 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.337206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893fec1-a3cb-4c1b-b493-548e763ea098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.337645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893fec1-a3cb-4c1b-b493-548e763ea098 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.338193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893fec1-a3cb-4c1b-b493-548e763ea098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.339772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893fec1-a3cb-4c1b-b493-548e763ea098 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.350363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1068/2168] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:25.354646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e601-99e5-4cf5-a82d-aec4f0738477 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.365323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e601-99e5-4cf5-a82d-aec4f0738477 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.370030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f298e-5591-486b-a725-1fc0c333cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.370635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f298e-5591-486b-a725-1fc0c333cc72 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.370920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f298e-5591-486b-a725-1fc0c333cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.371199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f298e-5591-486b-a725-1fc0c333cc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.371991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f298e-5591-486b-a725-1fc0c333cc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.373610 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f298e-5591-486b-a725-1fc0c333cc72 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.384936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1101/2169] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:25.389094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893fec1-a3cb-4c1b-b493-548e763ea098 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.399252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893fec1-a3cb-4c1b-b493-548e763ea098 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.404447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876203f-6cec-465e-8b67-9fc1b4b781ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.405167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876203f-6cec-465e-8b67-9fc1b4b781ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.405462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876203f-6cec-465e-8b67-9fc1b4b781ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.405776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876203f-6cec-465e-8b67-9fc1b4b781ac admin admin] PATH_INFO: `/v3/projects/a4212d77f8894b36b4533735171f56bb/users/141649da2a9a4e66aa15ea2b31d1d2cc/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.426880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876203f-6cec-465e-8b67-9fc1b4b781ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4212d77f8894b36b4533735171f56bb, user_id=141649da2a9a4e66aa15ea2b31d1d2cc, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.429579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876203f-6cec-465e-8b67-9fc1b4b781ac admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.442449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1069/2170] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:25 2022] PUT /identity/v3/projects/a4212d77f8894b36b4533735171f56bb/users/141649da2a9a4e66aa15ea2b31d1d2cc/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:25.453900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2fc49-137d-430b-8493-430b586a4d75 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.454189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2fc49-137d-430b-8493-430b586a4d75 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.454466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2fc49-137d-430b-8493-430b586a4d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.481791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-41f2fc49-137d-430b-8493-430b586a4d75 None None] MFA Rules not processed for user `141649da2a9a4e66aa15ea2b31d1d2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:25.482996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-41f2fc49-137d-430b-8493-430b586a4d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:25.523428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:25.554512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1102/2171] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:25.559064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876203f-6cec-465e-8b67-9fc1b4b781ac admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.630532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:25.659691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876203f-6cec-465e-8b67-9fc1b4b781ac admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.665171 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb7be9-b2c0-4f7d-b454-ec445f001897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.665819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb7be9-b2c0-4f7d-b454-ec445f001897 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.666105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb7be9-b2c0-4f7d-b454-ec445f001897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.666500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb7be9-b2c0-4f7d-b454-ec445f001897 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.667153 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb7be9-b2c0-4f7d-b454-ec445f001897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.669235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb7be9-b2c0-4f7d-b454-ec445f001897 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.701908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1070/2172] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:25 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:25.708685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2fc49-137d-430b-8493-430b586a4d75 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.721632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2fc49-137d-430b-8493-430b586a4d75 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.787529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57597-b4ee-47a8-aaf4-9b79008c968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.788512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57597-b4ee-47a8-aaf4-9b79008c968b admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.788881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57597-b4ee-47a8-aaf4-9b79008c968b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.789373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d57597-b4ee-47a8-aaf4-9b79008c968b admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.790321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d57597-b4ee-47a8-aaf4-9b79008c968b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.792586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d57597-b4ee-47a8-aaf4-9b79008c968b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.815857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1103/2173] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:25 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:25.819772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb7be9-b2c0-4f7d-b454-ec445f001897 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.830385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb7be9-b2c0-4f7d-b454-ec445f001897 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.836813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe617ff-9b68-4950-8830-7eb5111d0ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.837706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe617ff-9b68-4950-8830-7eb5111d0ebe admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.838088 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe617ff-9b68-4950-8830-7eb5111d0ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.838488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe617ff-9b68-4950-8830-7eb5111d0ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.839229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe617ff-9b68-4950-8830-7eb5111d0ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.840952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe617ff-9b68-4950-8830-7eb5111d0ebe admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.871946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1071/2174] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:25.873418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57597-b4ee-47a8-aaf4-9b79008c968b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.890316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d57597-b4ee-47a8-aaf4-9b79008c968b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.899392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65916b35-38d2-4df6-b7d0-3859de5c1f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.900191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916b35-38d2-4df6-b7d0-3859de5c1f80 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.900648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916b35-38d2-4df6-b7d0-3859de5c1f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.901049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65916b35-38d2-4df6-b7d0-3859de5c1f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.901837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65916b35-38d2-4df6-b7d0-3859de5c1f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.904162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65916b35-38d2-4df6-b7d0-3859de5c1f80 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:25.922199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe617ff-9b68-4950-8830-7eb5111d0ebe admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:25.923331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1104/2175] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:25.934161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe617ff-9b68-4950-8830-7eb5111d0ebe admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:25.941780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f735e53-8846-451a-b856-3a7d3a983777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:25.942443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f735e53-8846-451a-b856-3a7d3a983777 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:25.942717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f735e53-8846-451a-b856-3a7d3a983777 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:25.943830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f735e53-8846-451a-b856-3a7d3a983777 admin admin] PATH_INFO: `/v3/projects/87e55db53fd1497bb13f2b4bb3eb1312/users/5ee9caf9728b423abd7e9acea53cc45f/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:25.975253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f735e53-8846-451a-b856-3a7d3a983777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e55db53fd1497bb13f2b4bb3eb1312, user_id=5ee9caf9728b423abd7e9acea53cc45f, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:25.978027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f735e53-8846-451a-b856-3a7d3a983777 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.000970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1072/2176] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:25 2022] PUT /identity/v3/projects/87e55db53fd1497bb13f2b4bb3eb1312/users/5ee9caf9728b423abd7e9acea53cc45f/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:26.011936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b53307-4fe0-44c7-b308-f1e273715880 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.012341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b53307-4fe0-44c7-b308-f1e273715880 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.012621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b53307-4fe0-44c7-b308-f1e273715880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.043878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-12b53307-4fe0-44c7-b308-f1e273715880 None None] MFA Rules not processed for user `5ee9caf9728b423abd7e9acea53cc45f`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:26.045021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-12b53307-4fe0-44c7-b308-f1e273715880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:26.133803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1105/2177] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:26.139103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f735e53-8846-451a-b856-3a7d3a983777 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.176739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b53307-4fe0-44c7-b308-f1e273715880 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.178286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-12b53307-4fe0-44c7-b308-f1e273715880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:26.215655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f735e53-8846-451a-b856-3a7d3a983777 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.222030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8da7-2c63-458b-b897-db9b1650bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.222804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8da7-2c63-458b-b897-db9b1650bf31 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.223152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8da7-2c63-458b-b897-db9b1650bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.223518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8da7-2c63-458b-b897-db9b1650bf31 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.224221 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c8da7-2c63-458b-b897-db9b1650bf31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.226536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c8da7-2c63-458b-b897-db9b1650bf31 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.235775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:26.260917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1073/2178] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:26 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:26.261819 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b53307-4fe0-44c7-b308-f1e273715880 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.265360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8da7-2c63-458b-b897-db9b1650bf31 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.323478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.324121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.324294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.324568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] PATH_INFO: `/v3/users/e6e12bc5cd464c43a2d3869b3b3d9853` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.325752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e12bc5cd464c43a2d3869b3b3d9853)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.327830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.328811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8da7-2c63-458b-b897-db9b1650bf31 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.334305 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4aed3-104c-4e13-9839-09c27c7455d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.334921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4aed3-104c-4e13-9839-09c27c7455d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.335209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4aed3-104c-4e13-9839-09c27c7455d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.335519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4aed3-104c-4e13-9839-09c27c7455d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.336153 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4aed3-104c-4e13-9839-09c27c7455d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.338201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4aed3-104c-4e13-9839-09c27c7455d3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.360440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1074/2179] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:26 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:26.365006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4aed3-104c-4e13-9839-09c27c7455d3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.372209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:26.375296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e12bc5cd464c43a2d3869b3b3d9853'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:26.375966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e12bc5cd464c43a2d3869b3b3d9853'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:26.376061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4aed3-104c-4e13-9839-09c27c7455d3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.383733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.383977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e12bc5cd464c43a2d3869b3b3d9853'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:26.384589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e12bc5cd464c43a2d3869b3b3d9853'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:26.384698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.385241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.385725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.386497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.388397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.397371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-c7c3cdfe-1e14-4c6f-a722-f1cd25d6c032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e12bc5cd464c43a2d3869b3b3d9853'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:26.399597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1075/2180] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:26.404046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.406124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:26.419613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796aaad-01cb-40a7-aa2c-5730cb05cf53 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.421337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1106/2181] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:26 2022] DELETE /identity/v3/users/e6e12bc5cd464c43a2d3869b3b3d9853 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:26.426905 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2069dd-0c3f-4b55-8d11-74a9f063e473 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.427190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2069dd-0c3f-4b55-8d11-74a9f063e473 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.428820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2069dd-0c3f-4b55-8d11-74a9f063e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.448921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ab2069dd-0c3f-4b55-8d11-74a9f063e473 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:26.450483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ab2069dd-0c3f-4b55-8d11-74a9f063e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:26.487629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320f50b-66be-44bb-8ba6-98e40df274d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.488863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f50b-66be-44bb-8ba6-98e40df274d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.489150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f50b-66be-44bb-8ba6-98e40df274d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.489426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320f50b-66be-44bb-8ba6-98e40df274d0 admin admin] PATH_INFO: `/v3/projects/93ab24c11f494b1183b8444b5297d67a/users/61b56030e405415bb94639f84488b2d5/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.503828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320f50b-66be-44bb-8ba6-98e40df274d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ab24c11f494b1183b8444b5297d67a, user_id=61b56030e405415bb94639f84488b2d5, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.507277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320f50b-66be-44bb-8ba6-98e40df274d0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.520756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1076/2182] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:26 2022] PUT /identity/v3/projects/93ab24c11f494b1183b8444b5297d67a/users/61b56030e405415bb94639f84488b2d5/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:26.524597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320f50b-66be-44bb-8ba6-98e40df274d0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.525423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1107/2183] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:26.534593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2069dd-0c3f-4b55-8d11-74a9f063e473 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.535999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ab2069dd-0c3f-4b55-8d11-74a9f063e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:26.555936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:26.590893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320f50b-66be-44bb-8ba6-98e40df274d0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.595542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29c8a5-0b14-4a2e-ac0e-12c0da78f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.596155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c8a5-0b14-4a2e-ac0e-12c0da78f18f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.596436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c8a5-0b14-4a2e-ac0e-12c0da78f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.596712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c8a5-0b14-4a2e-ac0e-12c0da78f18f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.597354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29c8a5-0b14-4a2e-ac0e-12c0da78f18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.598992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2069dd-0c3f-4b55-8d11-74a9f063e473 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.599106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29c8a5-0b14-4a2e-ac0e-12c0da78f18f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.609100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1077/2184] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:26.613139 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29c8a5-0b14-4a2e-ac0e-12c0da78f18f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.623528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29c8a5-0b14-4a2e-ac0e-12c0da78f18f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.628319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db2898-5960-46be-8153-d2cc86065372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.629531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2898-5960-46be-8153-d2cc86065372 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.629866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2898-5960-46be-8153-d2cc86065372 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.630131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db2898-5960-46be-8153-d2cc86065372 admin admin] PATH_INFO: `/v3/projects/93ab24c11f494b1183b8444b5297d67a/users/61b56030e405415bb94639f84488b2d5/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.632046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db2898-5960-46be-8153-d2cc86065372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ab24c11f494b1183b8444b5297d67a, user_id=61b56030e405415bb94639f84488b2d5, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.634779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db2898-5960-46be-8153-d2cc86065372 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.645482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1078/2185] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:26 2022] PUT /identity/v3/projects/93ab24c11f494b1183b8444b5297d67a/users/61b56030e405415bb94639f84488b2d5/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:26.650665 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.651279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.651557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.651838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.655587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff13e-a141-463c-80b8-a6295689e741 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.655878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff13e-a141-463c-80b8-a6295689e741 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.656158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff13e-a141-463c-80b8-a6295689e741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.661187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.662829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.672400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1108/2186] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:26.684479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-cbaff13e-a141-463c-80b8-a6295689e741 None None] MFA Rules not processed for user `61b56030e405415bb94639f84488b2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:26.685758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cbaff13e-a141-463c-80b8-a6295689e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:26.735775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:26.763081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1079/2187] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:26.775854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.777338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:26.840141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5556c-210a-4182-af5b-f83535b38a88 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:26.891844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b63f1-d416-4303-b108-2bd139eb2e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:26.892452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b63f1-d416-4303-b108-2bd139eb2e30 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:26.892730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b63f1-d416-4303-b108-2bd139eb2e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:26.893000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b63f1-d416-4303-b108-2bd139eb2e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:26.902995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b63f1-d416-4303-b108-2bd139eb2e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:26.904429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b63f1-d416-4303-b108-2bd139eb2e30 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:26.914581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1109/2188] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:26.953206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff13e-a141-463c-80b8-a6295689e741 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:26.954632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cbaff13e-a141-463c-80b8-a6295689e741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:27.025535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff13e-a141-463c-80b8-a6295689e741 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:27.030115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:27.030824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:27.031016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:27.031290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] PATH_INFO: `/v3/projects/889297db69ac43419a36fd7aa88b6c7b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:27.032416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=889297db69ac43419a36fd7aa88b6c7b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:27.034347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:27.098803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889297db69ac43419a36fd7aa88b6c7b', 'request_id': 'req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.105209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889297db69ac43419a36fd7aa88b6c7b', 'request_id': 'req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.116775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889297db69ac43419a36fd7aa88b6c7b', 'request_id': 'req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.129351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] The token cache is being invalidate because project 889297db69ac43419a36fd7aa88b6c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:27.129683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.130405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.132161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1080/2189] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:26 2022] DELETE /identity/v3/projects/889297db69ac43419a36fd7aa88b6c7b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:27.135987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b63f1-d416-4303-b108-2bd139eb2e30 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:27.153772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b63f1-d416-4303-b108-2bd139eb2e30 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:27.239472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:27.294237 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:27.295220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:27.295682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:27.296235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] PATH_INFO: `/v3/users/c2fe1704fd55458eae94912d98ba0178` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:27.298013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fe1704fd55458eae94912d98ba0178)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:27.300360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:27.430814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fe1704fd55458eae94912d98ba0178'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.431656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fe1704fd55458eae94912d98ba0178'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.440943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fe1704fd55458eae94912d98ba0178'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.441726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fe1704fd55458eae94912d98ba0178'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.456643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fe1704fd55458eae94912d98ba0178'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.473689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1110/2190] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:27 2022] DELETE /identity/v3/users/c2fe1704fd55458eae94912d98ba0178 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:27.594861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:27.596401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:27.663388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d96e7f-cb3f-413c-8f7d-367931cf1f51 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:27.697214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:27.724552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:27.725175 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:27.725456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:27.725776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:27.727553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:27.779066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:27.780660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:27.795736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:27.797336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:27.808510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1081/2191] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:27.855787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f2f52-d55a-423a-9aaf-648c1f8f7ae3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:27.860498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:27.861136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:27.861421 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:27.861725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] PATH_INFO: `/v3/projects/d2c6a4c2f2fa46238f77ae18e2a2528d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:27.862942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c6a4c2f2fa46238f77ae18e2a2528d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:27.865670 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:27.915130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c6a4c2f2fa46238f77ae18e2a2528d', 'request_id': 'req-054d9fdf-5b58-4202-80a8-2cc89b39af58'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.919576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:27.921836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c6a4c2f2fa46238f77ae18e2a2528d', 'request_id': 'req-054d9fdf-5b58-4202-80a8-2cc89b39af58'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.931869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c6a4c2f2fa46238f77ae18e2a2528d', 'request_id': 'req-054d9fdf-5b58-4202-80a8-2cc89b39af58'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.950173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] The token cache is being invalidate because project d2c6a4c2f2fa46238f77ae18e2a2528d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:27.950173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.950885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:27.952729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1111/2192] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:27 2022] DELETE /identity/v3/projects/d2c6a4c2f2fa46238f77ae18e2a2528d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:27.957390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:27.971501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920bac7-9b07-4f4d-8e39-1c625961655e service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:28.040911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:28.041588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:28.041893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:28.042163 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] PATH_INFO: `/v3/users/33599fc21fee4f23a2fb3257b600c416` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:28.043332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33599fc21fee4f23a2fb3257b600c416)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:28.045251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:28.124628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33599fc21fee4f23a2fb3257b600c416'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.125355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33599fc21fee4f23a2fb3257b600c416'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.135701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33599fc21fee4f23a2fb3257b600c416'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.136323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33599fc21fee4f23a2fb3257b600c416'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.145647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33599fc21fee4f23a2fb3257b600c416'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.168794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1082/2193] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:27 2022] DELETE /identity/v3/users/33599fc21fee4f23a2fb3257b600c416 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:28.747575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:28.749265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:28.763129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d9fdf-5b58-4202-80a8-2cc89b39af58 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:28.829535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:28.830285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:28.830752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:28.831232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] PATH_INFO: `/v3/users/cd2da74eb4614fe0bd6dceaf75e76a49` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:28.833273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2da74eb4614fe0bd6dceaf75e76a49)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:28.835821 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:28.857004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:28.858559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:28.881441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:28.894012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84550ab-4b6b-4f97-b896-cae55aff560a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:28.898569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2da74eb4614fe0bd6dceaf75e76a49'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.899277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2da74eb4614fe0bd6dceaf75e76a49'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.901508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:28.902389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:28.902733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:28.903155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] PATH_INFO: `/v3/projects/069570a26b8843d194fc63f8f3673728` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:28.904506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=069570a26b8843d194fc63f8f3673728)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:28.906456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:28.907060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2da74eb4614fe0bd6dceaf75e76a49'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.907855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2da74eb4614fe0bd6dceaf75e76a49'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.923126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f3acd70-99ea-4e0c-b0ac-8ba601f5f448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2da74eb4614fe0bd6dceaf75e76a49'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.940275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1112/2194] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:28 2022] DELETE /identity/v3/users/cd2da74eb4614fe0bd6dceaf75e76a49 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:28.945276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077661a4-af86-44f5-99a7-44eb9c425202 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:28.945614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077661a4-af86-44f5-99a7-44eb9c425202 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:28.945886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077661a4-af86-44f5-99a7-44eb9c425202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:28.958426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069570a26b8843d194fc63f8f3673728', 'request_id': 'req-a4b9a6db-c353-4f84-9968-0b87eb61d6be'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.966464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069570a26b8843d194fc63f8f3673728', 'request_id': 'req-a4b9a6db-c353-4f84-9968-0b87eb61d6be'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.968367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-077661a4-af86-44f5-99a7-44eb9c425202 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:28.969730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-077661a4-af86-44f5-99a7-44eb9c425202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:28.975784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069570a26b8843d194fc63f8f3673728', 'request_id': 'req-a4b9a6db-c353-4f84-9968-0b87eb61d6be'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.988797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] The token cache is being invalidate because project 069570a26b8843d194fc63f8f3673728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:28.989679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.990346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:28.991878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1083/2195] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:28 2022] DELETE /identity/v3/projects/069570a26b8843d194fc63f8f3673728 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:29.041803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1113/2196] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:29.050550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:29.052896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:29.120650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a6db-c353-4f84-9968-0b87eb61d6be admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:29.124413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd62ff0-95cf-4c4e-9e00-9428a949c9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:29.125042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd62ff0-95cf-4c4e-9e00-9428a949c9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:29.125325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd62ff0-95cf-4c4e-9e00-9428a949c9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:29.125622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd62ff0-95cf-4c4e-9e00-9428a949c9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:29.137193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd62ff0-95cf-4c4e-9e00-9428a949c9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:29.139840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd62ff0-95cf-4c4e-9e00-9428a949c9d1 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:29.154891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1084/2197] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:29.482150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077661a4-af86-44f5-99a7-44eb9c425202 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:29.483641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-077661a4-af86-44f5-99a7-44eb9c425202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:29.491238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:29.507416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077661a4-af86-44f5-99a7-44eb9c425202 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:29.512230 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:29.512925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:29.513207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:29.513479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] PATH_INFO: `/v3/projects/a85e57e9d65345ac8b5feb7546441d71` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:29.514633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85e57e9d65345ac8b5feb7546441d71)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:29.516674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:29.564822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85e57e9d65345ac8b5feb7546441d71', 'request_id': 'req-41583ecb-24ff-48ec-89ba-e3f839ea6af4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.570591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85e57e9d65345ac8b5feb7546441d71', 'request_id': 'req-41583ecb-24ff-48ec-89ba-e3f839ea6af4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.576731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85e57e9d65345ac8b5feb7546441d71', 'request_id': 'req-41583ecb-24ff-48ec-89ba-e3f839ea6af4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.590363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] The token cache is being invalidate because project a85e57e9d65345ac8b5feb7546441d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:29.590659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.591300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-41583ecb-24ff-48ec-89ba-e3f839ea6af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.592851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1114/2198] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:29 2022] DELETE /identity/v3/projects/a85e57e9d65345ac8b5feb7546441d71 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:29.596954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd62ff0-95cf-4c4e-9e00-9428a949c9d1 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:29.609837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd62ff0-95cf-4c4e-9e00-9428a949c9d1 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:29.684168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:29.684804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:29.685085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:29.685467 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] PATH_INFO: `/v3/users/967eea8d383f4880badda97e899d1e25` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:29.686638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=967eea8d383f4880badda97e899d1e25)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:29.688942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:29.735309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:29.753645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967eea8d383f4880badda97e899d1e25'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.754870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967eea8d383f4880badda97e899d1e25'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.764005 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967eea8d383f4880badda97e899d1e25'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.764823 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967eea8d383f4880badda97e899d1e25'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.774740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967eea8d383f4880badda97e899d1e25'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:29.795358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1085/2199] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:29 2022] DELETE /identity/v3/users/967eea8d383f4880badda97e899d1e25 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:29.868724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9e62-9987-47ef-8127-94951e4c6d2a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:29.869789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9e62-9987-47ef-8127-94951e4c6d2a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:29.870217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9e62-9987-47ef-8127-94951e4c6d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:29.901335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e9bc9e62-9987-47ef-8127-94951e4c6d2a None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:29.902763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e9bc9e62-9987-47ef-8127-94951e4c6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:29.969907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1115/2200] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:30.039521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.041519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:30.154966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9e62-9987-47ef-8127-94951e4c6d2a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.156834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e9bc9e62-9987-47ef-8127-94951e4c6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:30.160168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44953b-9a8c-4f27-b3e1-2378cdf57bbf admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:30.166560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c588c-a742-43a2-b702-14e3c13cdb39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:30.167193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c588c-a742-43a2-b702-14e3c13cdb39 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.167480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c588c-a742-43a2-b702-14e3c13cdb39 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.167838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c588c-a742-43a2-b702-14e3c13cdb39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.178813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c588c-a742-43a2-b702-14e3c13cdb39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:30.180500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c588c-a742-43a2-b702-14e3c13cdb39 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:30.195343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1086/2201] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:50:30.248391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc9e62-9987-47ef-8127-94951e4c6d2a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:30.253535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:30.254788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.255072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.255347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] PATH_INFO: `/v3/projects/68bdfd692817421689c602e244e09631` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.256486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68bdfd692817421689c602e244e09631)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:30.258438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:30.304892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:30.322159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68bdfd692817421689c602e244e09631', 'request_id': 'req-b414e2e4-d026-4611-9663-279562795244'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:30.328693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68bdfd692817421689c602e244e09631', 'request_id': 'req-b414e2e4-d026-4611-9663-279562795244'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:30.335607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68bdfd692817421689c602e244e09631', 'request_id': 'req-b414e2e4-d026-4611-9663-279562795244'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:30.348746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] The token cache is being invalidate because project 68bdfd692817421689c602e244e09631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:30.349044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:30.349742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b414e2e4-d026-4611-9663-279562795244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:30.351403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1116/2202] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:30 2022] DELETE /identity/v3/projects/68bdfd692817421689c602e244e09631 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:30.356338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e7c4-88cd-4157-a38b-e5ef27370e2d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.356624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e7c4-88cd-4157-a38b-e5ef27370e2d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.356902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e7c4-88cd-4157-a38b-e5ef27370e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.378370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b271e7c4-88cd-4157-a38b-e5ef27370e2d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:30.380280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b271e7c4-88cd-4157-a38b-e5ef27370e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:30.460872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1087/2203] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:30.469785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295f8ce-c9ed-484a-9554-5d9608865446 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.470077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295f8ce-c9ed-484a-9554-5d9608865446 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.470374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295f8ce-c9ed-484a-9554-5d9608865446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.492616 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7295f8ce-c9ed-484a-9554-5d9608865446 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:30.493998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7295f8ce-c9ed-484a-9554-5d9608865446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:30.506056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1117/2204] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:30.507534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271e7c4-88cd-4157-a38b-e5ef27370e2d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.518927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271e7c4-88cd-4157-a38b-e5ef27370e2d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:30.524516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:30.525141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.525427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.525739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.526392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:30.526912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:30.528569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:30.545740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1088/2205] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:30.547538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295f8ce-c9ed-484a-9554-5d9608865446 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.559745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295f8ce-c9ed-484a-9554-5d9608865446 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:30.565942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f090c1-f48f-4c2e-ab8f-df51d8ab4a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:30.566590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f090c1-f48f-4c2e-ab8f-df51d8ab4a0d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.566871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f090c1-f48f-4c2e-ab8f-df51d8ab4a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.567146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f090c1-f48f-4c2e-ab8f-df51d8ab4a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.567927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f090c1-f48f-4c2e-ab8f-df51d8ab4a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:30.569874 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f090c1-f48f-4c2e-ab8f-df51d8ab4a0d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:30.606909 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1118/2206] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:30 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:30.611205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.623737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a8591-8db4-4abd-a7cc-d1625b3207fd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:30.650116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:30.715159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c819ce-a6bc-48bf-b7b1-2132d0b62902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:30.716414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c819ce-a6bc-48bf-b7b1-2132d0b62902 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.716864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c819ce-a6bc-48bf-b7b1-2132d0b62902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.717297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c819ce-a6bc-48bf-b7b1-2132d0b62902 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.718099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c819ce-a6bc-48bf-b7b1-2132d0b62902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:30.719999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c819ce-a6bc-48bf-b7b1-2132d0b62902 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:30.758006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1089/2207] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:30 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:30.759107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f090c1-f48f-4c2e-ab8f-df51d8ab4a0d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.772418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f090c1-f48f-4c2e-ab8f-df51d8ab4a0d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:30.780972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca8237-b012-4f9b-aeeb-334189d8a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:30.781701 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca8237-b012-4f9b-aeeb-334189d8a84d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.781981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca8237-b012-4f9b-aeeb-334189d8a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.782251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca8237-b012-4f9b-aeeb-334189d8a84d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.782898 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca8237-b012-4f9b-aeeb-334189d8a84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:30.784812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca8237-b012-4f9b-aeeb-334189d8a84d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:30.796293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1119/2208] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:30.801724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c819ce-a6bc-48bf-b7b1-2132d0b62902 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.812148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c819ce-a6bc-48bf-b7b1-2132d0b62902 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:30.817508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739084-379e-486b-9d7f-084b941c8a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:30.818157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739084-379e-486b-9d7f-084b941c8a45 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.818440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739084-379e-486b-9d7f-084b941c8a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.818742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739084-379e-486b-9d7f-084b941c8a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.819382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95739084-379e-486b-9d7f-084b941c8a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:30.821087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95739084-379e-486b-9d7f-084b941c8a45 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:30.828536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3d4d-7bcb-4633-a62b-a627ecf6b938 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.828854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3d4d-7bcb-4633-a62b-a627ecf6b938 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.829126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3d4d-7bcb-4633-a62b-a627ecf6b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.834113 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1090/2209] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:30.838165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739084-379e-486b-9d7f-084b941c8a45 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.847856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739084-379e-486b-9d7f-084b941c8a45 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:30.849463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2c0d3d4d-7bcb-4633-a62b-a627ecf6b938 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:30.850689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c0d3d4d-7bcb-4633-a62b-a627ecf6b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:30.852927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498c589-7bb3-4878-aa27-f15ff7610de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:30.853578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498c589-7bb3-4878-aa27-f15ff7610de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.853894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498c589-7bb3-4878-aa27-f15ff7610de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.854171 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498c589-7bb3-4878-aa27-f15ff7610de5 admin admin] PATH_INFO: `/v3/projects/ffcd19010bca48af955245b5dc2b705b/users/96b65299c1dc4aa58bd08cccf6d7a652/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.870773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498c589-7bb3-4878-aa27-f15ff7610de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcd19010bca48af955245b5dc2b705b, user_id=96b65299c1dc4aa58bd08cccf6d7a652, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:30.873473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498c589-7bb3-4878-aa27-f15ff7610de5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:30.888411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1091/2210] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:30 2022] PUT /identity/v3/projects/ffcd19010bca48af955245b5dc2b705b/users/96b65299c1dc4aa58bd08cccf6d7a652/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:30.899006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5657-a30c-4a7d-bbd4-7a28cf24ffc9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:30.899398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5657-a30c-4a7d-bbd4-7a28cf24ffc9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:30.899833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5657-a30c-4a7d-bbd4-7a28cf24ffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:30.912154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1120/2211] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 4 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:30.926842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d3d4d-7bcb-4633-a62b-a627ecf6b938 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:30.928228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c0d3d4d-7bcb-4633-a62b-a627ecf6b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:30.928717 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d4ed5657-a30c-4a7d-bbd4-7a28cf24ffc9 None None] MFA Rules not processed for user `96b65299c1dc4aa58bd08cccf6d7a652`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:30.929942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d4ed5657-a30c-4a7d-bbd4-7a28cf24ffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:31.006983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1092/2212] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:31.007179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d3d4d-7bcb-4633-a62b-a627ecf6b938 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.011580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5657-a30c-4a7d-bbd4-7a28cf24ffc9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.037285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:31.093496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19133409-95de-47d3-a69d-bf2ae7c0e858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.094158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19133409-95de-47d3-a69d-bf2ae7c0e858 service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.094439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19133409-95de-47d3-a69d-bf2ae7c0e858 service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.094882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19133409-95de-47d3-a69d-bf2ae7c0e858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.102712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5657-a30c-4a7d-bbd4-7a28cf24ffc9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.110271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038d42-e653-437f-aaf6-8534003fea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.111531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038d42-e653-437f-aaf6-8534003fea6e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.111914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038d42-e653-437f-aaf6-8534003fea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.112343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf038d42-e653-437f-aaf6-8534003fea6e admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.113000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf038d42-e653-437f-aaf6-8534003fea6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.115665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf038d42-e653-437f-aaf6-8534003fea6e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.134632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:31.165047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1093/2213] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:31 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:31.166057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038d42-e653-437f-aaf6-8534003fea6e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.171041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19133409-95de-47d3-a69d-bf2ae7c0e858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.173280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19133409-95de-47d3-a69d-bf2ae7c0e858 service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.182545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1121/2214] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 12:50:31.249689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf038d42-e653-437f-aaf6-8534003fea6e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.254732 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237316a1-2155-41f5-a3bc-9bc2c4e6fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.255336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237316a1-2155-41f5-a3bc-9bc2c4e6fbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.256186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237316a1-2155-41f5-a3bc-9bc2c4e6fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.256186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237316a1-2155-41f5-a3bc-9bc2c4e6fbf0 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.256652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237316a1-2155-41f5-a3bc-9bc2c4e6fbf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.258763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237316a1-2155-41f5-a3bc-9bc2c4e6fbf0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.296186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1094/2215] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:31 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:31.300534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19133409-95de-47d3-a69d-bf2ae7c0e858 service swift] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.312478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19133409-95de-47d3-a69d-bf2ae7c0e858 service swift] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.321677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e2df-2435-4e5e-bc9d-f0f30f3d10a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.322309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e2df-2435-4e5e-bc9d-f0f30f3d10a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.322595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e2df-2435-4e5e-bc9d-f0f30f3d10a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.322870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6e2df-2435-4e5e-bc9d-f0f30f3d10a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.323518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e2df-2435-4e5e-bc9d-f0f30f3d10a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.325124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6e2df-2435-4e5e-bc9d-f0f30f3d10a3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.336337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1122/2216] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:31.340661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237316a1-2155-41f5-a3bc-9bc2c4e6fbf0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.351660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237316a1-2155-41f5-a3bc-9bc2c4e6fbf0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.356580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8447ff-86e2-44ba-b974-9b8511047e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.357243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8447ff-86e2-44ba-b974-9b8511047e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.357523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8447ff-86e2-44ba-b974-9b8511047e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.357838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8447ff-86e2-44ba-b974-9b8511047e39 admin admin] PATH_INFO: `/v3/projects/549579d741db4bea866b1f755f7e2954/users/3056eb48672d4114b5ca18653a8bf477/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.374300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8447ff-86e2-44ba-b974-9b8511047e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549579d741db4bea866b1f755f7e2954, user_id=3056eb48672d4114b5ca18653a8bf477, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.378484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8447ff-86e2-44ba-b974-9b8511047e39 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.393388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1095/2217] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:31 2022] PUT /identity/v3/projects/549579d741db4bea866b1f755f7e2954/users/3056eb48672d4114b5ca18653a8bf477/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:31.402712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e2df-2435-4e5e-bc9d-f0f30f3d10a3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.417852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6e2df-2435-4e5e-bc9d-f0f30f3d10a3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.480947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205fb7-145d-425b-9a49-39c87698cf89 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.481231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205fb7-145d-425b-9a49-39c87698cf89 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.481507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205fb7-145d-425b-9a49-39c87698cf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.485324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7216887-18ee-4f1b-b157-5f631501260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.486508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216887-18ee-4f1b-b157-5f631501260f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.486508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216887-18ee-4f1b-b157-5f631501260f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.486508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216887-18ee-4f1b-b157-5f631501260f admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.487140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7216887-18ee-4f1b-b157-5f631501260f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.489305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7216887-18ee-4f1b-b157-5f631501260f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.501476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1123/2218] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:31.506151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7216887-18ee-4f1b-b157-5f631501260f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.506385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9c205fb7-145d-425b-9a49-39c87698cf89 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:31.507591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9c205fb7-145d-425b-9a49-39c87698cf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:31.517911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7216887-18ee-4f1b-b157-5f631501260f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.523200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b722d-e6f8-4a2b-b334-72da20cc4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.523857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b722d-e6f8-4a2b-b334-72da20cc4ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.524134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b722d-e6f8-4a2b-b334-72da20cc4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.524404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b722d-e6f8-4a2b-b334-72da20cc4ff1 admin admin] PATH_INFO: `/v3/projects/549579d741db4bea866b1f755f7e2954/users/3056eb48672d4114b5ca18653a8bf477/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.526375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b722d-e6f8-4a2b-b334-72da20cc4ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549579d741db4bea866b1f755f7e2954, user_id=3056eb48672d4114b5ca18653a8bf477, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.529019 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b722d-e6f8-4a2b-b334-72da20cc4ff1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.551336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1124/2219] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:31 2022] PUT /identity/v3/projects/549579d741db4bea866b1f755f7e2954/users/3056eb48672d4114b5ca18653a8bf477/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:31.552888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c030-4ac9-4e39-b81a-b3896dedbe7d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.553229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c030-4ac9-4e39-b81a-b3896dedbe7d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.553516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c030-4ac9-4e39-b81a-b3896dedbe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.583028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a572c030-4ac9-4e39-b81a-b3896dedbe7d None None] MFA Rules not processed for user `3056eb48672d4114b5ca18653a8bf477`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:31.584266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a572c030-4ac9-4e39-b81a-b3896dedbe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:31.596291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1096/2220] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:50:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:31.621883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205fb7-145d-425b-9a49-39c87698cf89 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.624812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:31.669934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1125/2221] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:31.682042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c030-4ac9-4e39-b81a-b3896dedbe7d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.683544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a572c030-4ac9-4e39-b81a-b3896dedbe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:31.695367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205fb7-145d-425b-9a49-39c87698cf89 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.700299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:31.741346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c030-4ac9-4e39-b81a-b3896dedbe7d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.745057 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808938d1-ed57-4d49-833f-ec7dbc18f805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.745696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808938d1-ed57-4d49-833f-ec7dbc18f805 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.745979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808938d1-ed57-4d49-833f-ec7dbc18f805 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.746255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808938d1-ed57-4d49-833f-ec7dbc18f805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.755650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808938d1-ed57-4d49-833f-ec7dbc18f805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.757050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808938d1-ed57-4d49-833f-ec7dbc18f805 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.759591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c42d5-afff-4484-b872-aabe38e2a694 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.760199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c42d5-afff-4484-b872-aabe38e2a694 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.760484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c42d5-afff-4484-b872-aabe38e2a694 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.760757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c42d5-afff-4484-b872-aabe38e2a694 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.772433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1126/2222] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:31.803729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808938d1-ed57-4d49-833f-ec7dbc18f805 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:31.841914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c42d5-afff-4484-b872-aabe38e2a694 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.843543 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c42d5-afff-4484-b872-aabe38e2a694 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.854009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1097/2223] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:50:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:50:31.876715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808938d1-ed57-4d49-833f-ec7dbc18f805 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:31.883111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:31.883760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:31.884068 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:31.884345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] PATH_INFO: `/v3/users/96b65299c1dc4aa58bd08cccf6d7a652` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:31.889035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b65299c1dc4aa58bd08cccf6d7a652)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:31.891074 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:31.967477 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b65299c1dc4aa58bd08cccf6d7a652'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:31.968572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b65299c1dc4aa58bd08cccf6d7a652'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:31.979039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b65299c1dc4aa58bd08cccf6d7a652'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:31.980252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b65299c1dc4aa58bd08cccf6d7a652'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.005349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b65299c1dc4aa58bd08cccf6d7a652'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.008140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:32.026561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1127/2224] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:31 2022] DELETE /identity/v3/users/96b65299c1dc4aa58bd08cccf6d7a652 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:32.031674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc96d-6c68-4bd4-99a9-1a7376106fa7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:32.032014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc96d-6c68-4bd4-99a9-1a7376106fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:32.032310 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc96d-6c68-4bd4-99a9-1a7376106fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:32.041234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:32.042737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:32.056506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dcccc96d-6c68-4bd4-99a9-1a7376106fa7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:32.057771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dcccc96d-6c68-4bd4-99a9-1a7376106fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:32.117783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51b42-04ad-4d00-b58e-7e85efe335b7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:32.121438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6feeb-d7a0-442b-8cdd-069222c98719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:32.122086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6feeb-d7a0-442b-8cdd-069222c98719 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:32.122371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6feeb-d7a0-442b-8cdd-069222c98719 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:32.122646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6feeb-d7a0-442b-8cdd-069222c98719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:32.124568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-33c6feeb-d7a0-442b-8cdd-069222c98719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:32.137629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1098/2225] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:32.146983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc96d-6c68-4bd4-99a9-1a7376106fa7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:32.148917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dcccc96d-6c68-4bd4-99a9-1a7376106fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:32.209312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6feeb-d7a0-442b-8cdd-069222c98719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:32.211139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c6feeb-d7a0-442b-8cdd-069222c98719 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:32.222422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1128/2226] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:32.247372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc96d-6c68-4bd4-99a9-1a7376106fa7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:32.265367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:32.266512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:32.266812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:32.267160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:32.283794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:32.288447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:32.290420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:32.303844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1099/2227] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:32.315271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1108e2-991f-4cfe-be07-2a86f7d1722f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:32.316022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1108e2-991f-4cfe-be07-2a86f7d1722f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:32.317040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1108e2-991f-4cfe-be07-2a86f7d1722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:32.342320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9b1108e2-991f-4cfe-be07-2a86f7d1722f None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:32.344001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9b1108e2-991f-4cfe-be07-2a86f7d1722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:32.408880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1129/2228] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 4 12:50:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:32.423711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:32.425366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:32.513765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0e8d2-ea4e-4ab1-a61c-d2721bb057ac service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:32.521482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6099-f991-446e-99a0-67e3811e2be4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:32.522129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6099-f991-446e-99a0-67e3811e2be4 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:32.522414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6099-f991-446e-99a0-67e3811e2be4 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:32.522688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6099-f991-446e-99a0-67e3811e2be4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:32.531897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6099-f991-446e-99a0-67e3811e2be4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:32.533494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6099-f991-446e-99a0-67e3811e2be4 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:32.542447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1100/2229] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:50:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:50:32.650632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1108e2-991f-4cfe-be07-2a86f7d1722f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:32.652138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9b1108e2-991f-4cfe-be07-2a86f7d1722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:32.681943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1108e2-991f-4cfe-be07-2a86f7d1722f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:32.686738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:32.687383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:32.687673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:32.687949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] PATH_INFO: `/v3/projects/ffcd19010bca48af955245b5dc2b705b` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:32.689123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcd19010bca48af955245b5dc2b705b)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:32.691081 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:32.764719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:32.770040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcd19010bca48af955245b5dc2b705b', 'request_id': 'req-14faf01a-4f30-4d05-a201-766da84fcaf8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.776366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcd19010bca48af955245b5dc2b705b', 'request_id': 'req-14faf01a-4f30-4d05-a201-766da84fcaf8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.790074 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcd19010bca48af955245b5dc2b705b', 'request_id': 'req-14faf01a-4f30-4d05-a201-766da84fcaf8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.802535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] The token cache is being invalidate because project ffcd19010bca48af955245b5dc2b705b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:32.802826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.803470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.805250 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1130/2230] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:32 2022] DELETE /identity/v3/projects/ffcd19010bca48af955245b5dc2b705b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:32.809107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6099-f991-446e-99a0-67e3811e2be4 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:32.823763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6099-f991-446e-99a0-67e3811e2be4 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:32.900865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:32.901496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:32.901808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:32.902224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] PATH_INFO: `/v3/users/3056eb48672d4114b5ca18653a8bf477` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:32.903244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3056eb48672d4114b5ca18653a8bf477)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:32.905182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:32.986647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3056eb48672d4114b5ca18653a8bf477'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.987668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3056eb48672d4114b5ca18653a8bf477'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.995825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3056eb48672d4114b5ca18653a8bf477'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:32.996721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3056eb48672d4114b5ca18653a8bf477'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:33.005821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-7e29b92c-f6c8-4a45-b28f-8e0a5a8598a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3056eb48672d4114b5ca18653a8bf477'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:33.035575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1101/2231] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:32 2022] DELETE /identity/v3/users/3056eb48672d4114b5ca18653a8bf477 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:33.386597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:33.388734 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:33.419713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faf01a-4f30-4d05-a201-766da84fcaf8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:33.509908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:33.511382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:33.511667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:33.511940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] PATH_INFO: `/v3/projects/549579d741db4bea866b1f755f7e2954` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:33.514482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549579d741db4bea866b1f755f7e2954)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:33.517380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:33.595973 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549579d741db4bea866b1f755f7e2954', 'request_id': 'req-3783de31-7d48-4c73-8c98-d58bd6960097'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:33.615667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549579d741db4bea866b1f755f7e2954', 'request_id': 'req-3783de31-7d48-4c73-8c98-d58bd6960097'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:33.622683 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549579d741db4bea866b1f755f7e2954', 'request_id': 'req-3783de31-7d48-4c73-8c98-d58bd6960097'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:33.638730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] The token cache is being invalidate because project 549579d741db4bea866b1f755f7e2954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:33.638730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:33.639447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-3783de31-7d48-4c73-8c98-d58bd6960097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:33.640983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1131/2232] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:33 2022] DELETE /identity/v3/projects/549579d741db4bea866b1f755f7e2954 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:33.646492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766453-a52a-406d-861d-cb5aa0f3dbc2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:33.646905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766453-a52a-406d-861d-cb5aa0f3dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:33.647054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766453-a52a-406d-861d-cb5aa0f3dbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:33.654895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:33.669415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a0766453-a52a-406d-861d-cb5aa0f3dbc2 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:33.670864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a0766453-a52a-406d-861d-cb5aa0f3dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:33.740557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1102/2233] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:33.746519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575155-b3de-4a7b-a593-bd1a38802d8e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:33.747038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575155-b3de-4a7b-a593-bd1a38802d8e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:33.747328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575155-b3de-4a7b-a593-bd1a38802d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:33.768325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-f9575155-b3de-4a7b-a593-bd1a38802d8e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:33.770227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f9575155-b3de-4a7b-a593-bd1a38802d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:33.778222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1132/2234] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:33.782295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766453-a52a-406d-861d-cb5aa0f3dbc2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:33.793710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766453-a52a-406d-861d-cb5aa0f3dbc2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:33.798478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:33.799089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:33.799433 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:33.799647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:33.800286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:33.800587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:33.802303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:33.818080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1103/2235] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:33.819193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575155-b3de-4a7b-a593-bd1a38802d8e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:33.829323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575155-b3de-4a7b-a593-bd1a38802d8e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:33.835023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd63c7-e15a-434b-ad33-310ce93f29f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:33.835812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd63c7-e15a-434b-ad33-310ce93f29f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:33.836161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd63c7-e15a-434b-ad33-310ce93f29f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:33.837864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd63c7-e15a-434b-ad33-310ce93f29f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:33.838536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd63c7-e15a-434b-ad33-310ce93f29f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:33.840730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd63c7-e15a-434b-ad33-310ce93f29f8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:33.872644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1133/2236] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:33 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:33.873800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:33.884524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa89914-f341-4c96-9d77-4a4c8464d895 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:33.949788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f05e-ca71-4ba7-8b19-c798225560a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:33.950413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f05e-ca71-4ba7-8b19-c798225560a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:33.950696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f05e-ca71-4ba7-8b19-c798225560a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:33.950974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573f05e-ca71-4ba7-8b19-c798225560a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:33.951614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573f05e-ca71-4ba7-8b19-c798225560a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:33.953675 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573f05e-ca71-4ba7-8b19-c798225560a9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:33.976421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1104/2237] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:33 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:33.980706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd63c7-e15a-434b-ad33-310ce93f29f8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:33.991204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd63c7-e15a-434b-ad33-310ce93f29f8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:33.996144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705482b0-f4dd-40a7-b6da-d61099208737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:33.997128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705482b0-f4dd-40a7-b6da-d61099208737 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:33.997547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705482b0-f4dd-40a7-b6da-d61099208737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:33.997888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705482b0-f4dd-40a7-b6da-d61099208737 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:33.998752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705482b0-f4dd-40a7-b6da-d61099208737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.001103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705482b0-f4dd-40a7-b6da-d61099208737 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.020577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1134/2238] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:34.021786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f05e-ca71-4ba7-8b19-c798225560a9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.032116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573f05e-ca71-4ba7-8b19-c798225560a9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.037945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e38fe-345f-4e04-a5c7-0815e770d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.038556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e38fe-345f-4e04-a5c7-0815e770d572 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.038834 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e38fe-345f-4e04-a5c7-0815e770d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.039193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e38fe-345f-4e04-a5c7-0815e770d572 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.039946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e38fe-345f-4e04-a5c7-0815e770d572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.041538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e38fe-345f-4e04-a5c7-0815e770d572 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.052514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1105/2239] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:34.056558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705482b0-f4dd-40a7-b6da-d61099208737 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.067205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705482b0-f4dd-40a7-b6da-d61099208737 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.072173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e15e4-f5eb-4725-9deb-c61ba78e9119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.072829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e15e4-f5eb-4725-9deb-c61ba78e9119 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.073113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e15e4-f5eb-4725-9deb-c61ba78e9119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.073391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e15e4-f5eb-4725-9deb-c61ba78e9119 admin admin] PATH_INFO: `/v3/projects/fc7a8828c90a46719952f27e652129db/users/3bd3048e39c544d48eb8875cd28e08b4/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.090987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e15e4-f5eb-4725-9deb-c61ba78e9119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7a8828c90a46719952f27e652129db, user_id=3bd3048e39c544d48eb8875cd28e08b4, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.093916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e15e4-f5eb-4725-9deb-c61ba78e9119 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.102540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:34.108888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1135/2240] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:34 2022] PUT /identity/v3/projects/fc7a8828c90a46719952f27e652129db/users/3bd3048e39c544d48eb8875cd28e08b4/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:34.121535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b58ff-e48b-4621-83c7-3d072e89107e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.122001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b58ff-e48b-4621-83c7-3d072e89107e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.122250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b58ff-e48b-4621-83c7-3d072e89107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.150851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-737b58ff-e48b-4621-83c7-3d072e89107e None None] MFA Rules not processed for user `3bd3048e39c544d48eb8875cd28e08b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:34.152107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-737b58ff-e48b-4621-83c7-3d072e89107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:34.232911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:34.247128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1106/2241] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:34.250584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e15e4-f5eb-4725-9deb-c61ba78e9119 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.330609 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e15e4-f5eb-4725-9deb-c61ba78e9119 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.336441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5a766-fb63-40eb-8804-55b51665a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.337064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a766-fb63-40eb-8804-55b51665a056 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.337359 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a766-fb63-40eb-8804-55b51665a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.337661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a766-fb63-40eb-8804-55b51665a056 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.338319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5a766-fb63-40eb-8804-55b51665a056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.340240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5a766-fb63-40eb-8804-55b51665a056 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.372692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1136/2242] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:34 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:34.377528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b58ff-e48b-4621-83c7-3d072e89107e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.390763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b58ff-e48b-4621-83c7-3d072e89107e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.469068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c7608-ebfb-4946-89c5-9115861948cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.469762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c7608-ebfb-4946-89c5-9115861948cf admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.470045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c7608-ebfb-4946-89c5-9115861948cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.470319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c7608-ebfb-4946-89c5-9115861948cf admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.470950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c7608-ebfb-4946-89c5-9115861948cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.473001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c7608-ebfb-4946-89c5-9115861948cf admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.495473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1107/2243] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:34 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:34.499502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5a766-fb63-40eb-8804-55b51665a056 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.510628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5a766-fb63-40eb-8804-55b51665a056 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.516010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a926da6-78ec-4ad4-b5bd-bdeab7c48bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.516588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a926da6-78ec-4ad4-b5bd-bdeab7c48bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.516896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a926da6-78ec-4ad4-b5bd-bdeab7c48bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.517232 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a926da6-78ec-4ad4-b5bd-bdeab7c48bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.518043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a926da6-78ec-4ad4-b5bd-bdeab7c48bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.520398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a926da6-78ec-4ad4-b5bd-bdeab7c48bb5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.535742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1137/2244] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:34.537008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c7608-ebfb-4946-89c5-9115861948cf admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.548408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c7608-ebfb-4946-89c5-9115861948cf admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.555566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.556281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.556632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.556970 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] PATH_INFO: `/v3/projects/76548d4cab1c483eab4618f4add58025/users/8a85f00bf72046b898edb44aabd761bd/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.581137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76548d4cab1c483eab4618f4add58025, user_id=8a85f00bf72046b898edb44aabd761bd, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.586479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.601328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1108/2245] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:34 2022] PUT /identity/v3/projects/76548d4cab1c483eab4618f4add58025/users/8a85f00bf72046b898edb44aabd761bd/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:34.606703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a926da6-78ec-4ad4-b5bd-bdeab7c48bb5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.631564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a926da6-78ec-4ad4-b5bd-bdeab7c48bb5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.697576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.699485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:34.702588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ef2f0-9707-4ab5-bd0f-9d403dcbe3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.703208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ef2f0-9707-4ab5-bd0f-9d403dcbe3db admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.703490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ef2f0-9707-4ab5-bd0f-9d403dcbe3db admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.703763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ef2f0-9707-4ab5-bd0f-9d403dcbe3db admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.704549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ef2f0-9707-4ab5-bd0f-9d403dcbe3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.706159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ef2f0-9707-4ab5-bd0f-9d403dcbe3db admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.713225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346fb5a-c54f-4e97-b487-46c365ad2e7a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.718043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.718878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.718996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1138/2246] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:34.719101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.719220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] PATH_INFO: `/v3/users/141649da2a9a4e66aa15ea2b31d1d2cc` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.720362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] RBAC: Authorizing `identity:delete_user(user_id=141649da2a9a4e66aa15ea2b31d1d2cc)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.722646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.722805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ef2f0-9707-4ab5-bd0f-9d403dcbe3db admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.735283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ef2f0-9707-4ab5-bd0f-9d403dcbe3db admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.740848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb91030-d323-40b1-a49a-e88a29e569d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.741639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91030-d323-40b1-a49a-e88a29e569d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.741991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91030-d323-40b1-a49a-e88a29e569d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.742341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91030-d323-40b1-a49a-e88a29e569d4 admin admin] PATH_INFO: `/v3/projects/76548d4cab1c483eab4618f4add58025/users/8a85f00bf72046b898edb44aabd761bd/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.744502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb91030-d323-40b1-a49a-e88a29e569d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76548d4cab1c483eab4618f4add58025, user_id=8a85f00bf72046b898edb44aabd761bd, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:34.747519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb91030-d323-40b1-a49a-e88a29e569d4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:34.764154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1139/2247] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:34 2022] PUT /identity/v3/projects/76548d4cab1c483eab4618f4add58025/users/8a85f00bf72046b898edb44aabd761bd/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:34.776350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8df08-704d-4ea4-80ab-5a32af62c645 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.776661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8df08-704d-4ea4-80ab-5a32af62c645 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.777292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8df08-704d-4ea4-80ab-5a32af62c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.786327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141649da2a9a4e66aa15ea2b31d1d2cc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:34.787196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141649da2a9a4e66aa15ea2b31d1d2cc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:34.805804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141649da2a9a4e66aa15ea2b31d1d2cc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:34.805804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141649da2a9a4e66aa15ea2b31d1d2cc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:34.806727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-744e3907-70ef-4257-bd53-02987f0c992b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141649da2a9a4e66aa15ea2b31d1d2cc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:34.813796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-90c8df08-704d-4ea4-80ab-5a32af62c645 None None] MFA Rules not processed for user `8a85f00bf72046b898edb44aabd761bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:34.815052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-90c8df08-704d-4ea4-80ab-5a32af62c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:34.825955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1109/2248] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:34 2022] DELETE /identity/v3/users/141649da2a9a4e66aa15ea2b31d1d2cc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:34.830250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07cdb-5cf4-49b4-8589-8770de87b4ab None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.830539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07cdb-5cf4-49b4-8589-8770de87b4ab None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.830815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f07cdb-5cf4-49b4-8589-8770de87b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:34.849336 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-50f07cdb-5cf4-49b4-8589-8770de87b4ab None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:34.850585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-50f07cdb-5cf4-49b4-8589-8770de87b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:34.861364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:34.882865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:34.889695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1140/2249] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:34.900979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8df08-704d-4ea4-80ab-5a32af62c645 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.902363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-90c8df08-704d-4ea4-80ab-5a32af62c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:34.917514 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1110/2250] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:34.927886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f07cdb-5cf4-49b4-8589-8770de87b4ab None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:34.929284 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-50f07cdb-5cf4-49b4-8589-8770de87b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:34.962006 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8df08-704d-4ea4-80ab-5a32af62c645 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.986577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f07cdb-5cf4-49b4-8589-8770de87b4ab None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:34.990844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:34.991459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:34.991741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:34.992016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.001332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:35.002816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:35.011696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea68d0-fed5-4ebb-a9dc-f00f73c7d1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:35.012376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea68d0-fed5-4ebb-a9dc-f00f73c7d1ee service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.012777 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1111/2251] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:35.012915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea68d0-fed5-4ebb-a9dc-f00f73c7d1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.013099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea68d0-fed5-4ebb-a9dc-f00f73c7d1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.014969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-38ea68d0-fed5-4ebb-a9dc-f00f73c7d1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:35.082855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea68d0-fed5-4ebb-a9dc-f00f73c7d1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:35.084361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea68d0-fed5-4ebb-a9dc-f00f73c7d1ee service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:35.095064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:35.097148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:35.098592 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1141/2252] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:35.114405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863a2b-c50e-4b73-bb16-3585215ef852 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:35.120326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:35.121167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.121546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.121878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] PATH_INFO: `/v3/users/2cf5c941f14746cda4bf0c3491fc98da` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.123233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf5c941f14746cda4bf0c3491fc98da)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:35.125302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:35.186864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf5c941f14746cda4bf0c3491fc98da'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.187639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf5c941f14746cda4bf0c3491fc98da'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.200652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf5c941f14746cda4bf0c3491fc98da'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.201444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf5c941f14746cda4bf0c3491fc98da'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.211743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf5c941f14746cda4bf0c3491fc98da'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.234650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1112/2253] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:35 2022] DELETE /identity/v3/users/2cf5c941f14746cda4bf0c3491fc98da => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:35.239503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b5af-adae-4f19-94ab-b1e76f03d94b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.239791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b5af-adae-4f19-94ab-b1e76f03d94b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.240065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b5af-adae-4f19-94ab-b1e76f03d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.269402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8a71b5af-adae-4f19-94ab-b1e76f03d94b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:35.271003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8a71b5af-adae-4f19-94ab-b1e76f03d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:35.338600 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:35.358526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:35.359642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1142/2254] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:35.361013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:35.372713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b5af-adae-4f19-94ab-b1e76f03d94b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:35.374400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8a71b5af-adae-4f19-94ab-b1e76f03d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:35.400960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626835-4aee-40bf-85e6-be51a132f5b3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:35.412764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:35.414711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.415893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.416479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] PATH_INFO: `/v3/projects/a4212d77f8894b36b4533735171f56bb` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.419016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4212d77f8894b36b4533735171f56bb)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:35.425333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:35.463932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b5af-adae-4f19-94ab-b1e76f03d94b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:35.467713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84975de-a97e-43aa-93d5-67c745250bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:35.468330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84975de-a97e-43aa-93d5-67c745250bba service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.468611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84975de-a97e-43aa-93d5-67c745250bba service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.468884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84975de-a97e-43aa-93d5-67c745250bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.479715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84975de-a97e-43aa-93d5-67c745250bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:35.481295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84975de-a97e-43aa-93d5-67c745250bba service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:35.491837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1143/2255] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:35.503589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:35.509033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4212d77f8894b36b4533735171f56bb', 'request_id': 'req-5d4cfa60-27f6-4ce9-8407-2946623f46e0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.517924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4212d77f8894b36b4533735171f56bb', 'request_id': 'req-5d4cfa60-27f6-4ce9-8407-2946623f46e0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.533077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4212d77f8894b36b4533735171f56bb', 'request_id': 'req-5d4cfa60-27f6-4ce9-8407-2946623f46e0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.549015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] The token cache is being invalidate because project a4212d77f8894b36b4533735171f56bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:35.549272 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.550050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.551724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1113/2256] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:35 2022] DELETE /identity/v3/projects/a4212d77f8894b36b4533735171f56bb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:35.555936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84975de-a97e-43aa-93d5-67c745250bba service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:35.566768 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84975de-a97e-43aa-93d5-67c745250bba service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:35.640735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:35.641376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.641694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.641987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] PATH_INFO: `/v3/users/5ee9caf9728b423abd7e9acea53cc45f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.643123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee9caf9728b423abd7e9acea53cc45f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:35.645876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:35.697428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee9caf9728b423abd7e9acea53cc45f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.698321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee9caf9728b423abd7e9acea53cc45f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.702706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:35.704293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:35.709264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee9caf9728b423abd7e9acea53cc45f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.710082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee9caf9728b423abd7e9acea53cc45f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.722437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cfa60-27f6-4ce9-8407-2946623f46e0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:35.726922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8c4f7ea-4c7b-462d-ba03-3e719e4c531d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee9caf9728b423abd7e9acea53cc45f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.730677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:35.739260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.739945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.739945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] PATH_INFO: `/v3/projects/c7aa367839cf4cc9833541b1e6d362be` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.741265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7aa367839cf4cc9833541b1e6d362be)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:35.742460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1144/2257] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:35 2022] DELETE /identity/v3/users/5ee9caf9728b423abd7e9acea53cc45f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:35.743363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:35.806396 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7aa367839cf4cc9833541b1e6d362be', 'request_id': 'req-14bf83fe-437a-478b-9072-8a94486daeec'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.816082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7aa367839cf4cc9833541b1e6d362be', 'request_id': 'req-14bf83fe-437a-478b-9072-8a94486daeec'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.829494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7aa367839cf4cc9833541b1e6d362be', 'request_id': 'req-14bf83fe-437a-478b-9072-8a94486daeec'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.845695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] The token cache is being invalidate because project c7aa367839cf4cc9833541b1e6d362be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:35.846073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.846882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-14bf83fe-437a-478b-9072-8a94486daeec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:35.849341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1114/2258] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:35 2022] DELETE /identity/v3/projects/c7aa367839cf4cc9833541b1e6d362be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:35.855330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0297d-e21a-48e0-b439-3b2cc30be517 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.855330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0297d-e21a-48e0-b439-3b2cc30be517 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.855655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0297d-e21a-48e0-b439-3b2cc30be517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.880752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c0a0297d-e21a-48e0-b439-3b2cc30be517 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:35.882066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c0a0297d-e21a-48e0-b439-3b2cc30be517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:35.891062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:35.952219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1145/2259] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:35.960324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8959f-0a6f-4abc-9f12-4158476a1bbe None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:35.960606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8959f-0a6f-4abc-9f12-4158476a1bbe None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:35.968307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8959f-0a6f-4abc-9f12-4158476a1bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:35.992256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-bac8959f-0a6f-4abc-9f12-4158476a1bbe None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:35.993465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bac8959f-0a6f-4abc-9f12-4158476a1bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:36.001985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1115/2260] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:36.007007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0297d-e21a-48e0-b439-3b2cc30be517 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.017290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0297d-e21a-48e0-b439-3b2cc30be517 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.022863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.023471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.023752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.024292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.024666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:36.024964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.026612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.039081 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1146/2261] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:36.043260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8959f-0a6f-4abc-9f12-4158476a1bbe None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.052807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8959f-0a6f-4abc-9f12-4158476a1bbe None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.057762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.058377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.058660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.058937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.059619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.061518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.095130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1116/2262] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:36 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:36.096483 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.107084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded13ddb-4cea-40f7-974f-8c42674c6c1f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.135064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.136824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:36.176570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb193a-35b3-4f04-9b68-d6f1be5dcc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.177276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb193a-35b3-4f04-9b68-d6f1be5dcc85 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.177668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb193a-35b3-4f04-9b68-d6f1be5dcc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.178014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb193a-35b3-4f04-9b68-d6f1be5dcc85 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.178752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb193a-35b3-4f04-9b68-d6f1be5dcc85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.180713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb193a-35b3-4f04-9b68-d6f1be5dcc85 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.203799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1147/2263] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:36 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:36.205007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e713c65-518f-4882-a9c9-f8cd7e523070 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.207793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb193a-35b3-4f04-9b68-d6f1be5dcc85 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.209843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.210461 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.210741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.211012 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] PATH_INFO: `/v3/projects/87e55db53fd1497bb13f2b4bb3eb1312` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.212130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e55db53fd1497bb13f2b4bb3eb1312)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.214076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.218332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb193a-35b3-4f04-9b68-d6f1be5dcc85 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.224126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6770cf-bd47-4bd2-b273-b60984de006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.224771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6770cf-bd47-4bd2-b273-b60984de006e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.225056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6770cf-bd47-4bd2-b273-b60984de006e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.225333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6770cf-bd47-4bd2-b273-b60984de006e admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.226102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6770cf-bd47-4bd2-b273-b60984de006e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.227704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6770cf-bd47-4bd2-b273-b60984de006e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.239598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1148/2264] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:36.243630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6770cf-bd47-4bd2-b273-b60984de006e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.254485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:36.256319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6770cf-bd47-4bd2-b273-b60984de006e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.272867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e55db53fd1497bb13f2b4bb3eb1312', 'request_id': 'req-4ff98905-df70-4a2b-bcc2-97059445419e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.281340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e55db53fd1497bb13f2b4bb3eb1312', 'request_id': 'req-4ff98905-df70-4a2b-bcc2-97059445419e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.291316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e55db53fd1497bb13f2b4bb3eb1312', 'request_id': 'req-4ff98905-df70-4a2b-bcc2-97059445419e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.304972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] The token cache is being invalidate because project 87e55db53fd1497bb13f2b4bb3eb1312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:36.305255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.306020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.307598 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1117/2265] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:36 2022] DELETE /identity/v3/projects/87e55db53fd1497bb13f2b4bb3eb1312 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:36.311821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.313271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:36.332256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.333273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.333821 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.334304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.335111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.336755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.349082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1149/2266] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:36.353194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.355706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:36.374295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a6afb-54a5-466f-9a88-638dca246076 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.379812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545d4cb-fe87-4711-a31c-dbe7644b52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.380470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545d4cb-fe87-4711-a31c-dbe7644b52bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.380750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545d4cb-fe87-4711-a31c-dbe7644b52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.381062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545d4cb-fe87-4711-a31c-dbe7644b52bb admin admin] PATH_INFO: `/v3/projects/a070259364724d7ab23373310b569d6e/users/28d46c9f9371467fa4c37bf282f6aebb/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.392999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:36.397828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff98905-df70-4a2b-bcc2-97059445419e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.398986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545d4cb-fe87-4711-a31c-dbe7644b52bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a070259364724d7ab23373310b569d6e, user_id=28d46c9f9371467fa4c37bf282f6aebb, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.402254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545d4cb-fe87-4711-a31c-dbe7644b52bb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.403053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.403714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.404033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.404273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] PATH_INFO: `/v3/users/61b56030e405415bb94639f84488b2d5` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.405501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b56030e405415bb94639f84488b2d5)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.407590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.429783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1150/2267] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:36 2022] PUT /identity/v3/projects/a070259364724d7ab23373310b569d6e/users/28d46c9f9371467fa4c37bf282f6aebb/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:36.434549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b829-a65c-41dd-bef4-2be0a69aeab5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.434836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b829-a65c-41dd-bef4-2be0a69aeab5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.435119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b829-a65c-41dd-bef4-2be0a69aeab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.456678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-88e0b829-a65c-41dd-bef4-2be0a69aeab5 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:36.458585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-88e0b829-a65c-41dd-bef4-2be0a69aeab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:36.471792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b56030e405415bb94639f84488b2d5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.472991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b56030e405415bb94639f84488b2d5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.484832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b56030e405415bb94639f84488b2d5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.485456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b56030e405415bb94639f84488b2d5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.496848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b56030e405415bb94639f84488b2d5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:36.517350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1118/2268] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:36 2022] DELETE /identity/v3/users/61b56030e405415bb94639f84488b2d5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:36.554926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1151/2269] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:36.564689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.567058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:36.639295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:36.677074 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aa47c-786a-48fa-beab-ae978a13e7ba admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.681195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d3728-ffd9-4b40-ae9a-cbce8ec64019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.681925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3728-ffd9-4b40-ae9a-cbce8ec64019 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.682176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3728-ffd9-4b40-ae9a-cbce8ec64019 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.682637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3728-ffd9-4b40-ae9a-cbce8ec64019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.773505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d3728-ffd9-4b40-ae9a-cbce8ec64019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.775463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d3728-ffd9-4b40-ae9a-cbce8ec64019 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.792162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1119/2270] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:36.907890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0b829-a65c-41dd-bef4-2be0a69aeab5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:36.909464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-88e0b829-a65c-41dd-bef4-2be0a69aeab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:36.924225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0b829-a65c-41dd-bef4-2be0a69aeab5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:36.935435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:36.936135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:36.936407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:36.936684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] PATH_INFO: `/v3/projects/93ab24c11f494b1183b8444b5297d67a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:36.937914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ab24c11f494b1183b8444b5297d67a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:36.939873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:36.994586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ab24c11f494b1183b8444b5297d67a', 'request_id': 'req-6a70122b-2299-4a26-9033-bded2904f9b7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:37.001680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ab24c11f494b1183b8444b5297d67a', 'request_id': 'req-6a70122b-2299-4a26-9033-bded2904f9b7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:37.009633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ab24c11f494b1183b8444b5297d67a', 'request_id': 'req-6a70122b-2299-4a26-9033-bded2904f9b7'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:37.025514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] The token cache is being invalidate because project 93ab24c11f494b1183b8444b5297d67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:37.025855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:37.027306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6a70122b-2299-4a26-9033-bded2904f9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:37.029376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1152/2271] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:36 2022] DELETE /identity/v3/projects/93ab24c11f494b1183b8444b5297d67a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:37.037043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6442f-5913-474a-8842-a755cf6c10a6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.037741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6442f-5913-474a-8842-a755cf6c10a6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.038035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6442f-5913-474a-8842-a755cf6c10a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.061785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-77e6442f-5913-474a-8842-a755cf6c10a6 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:37.063130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-77e6442f-5913-474a-8842-a755cf6c10a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:37.155017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1120/2272] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:37.165280 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19488580-56b6-4615-b691-ffffb51ed85f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.165673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19488580-56b6-4615-b691-ffffb51ed85f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.166020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19488580-56b6-4615-b691-ffffb51ed85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.189683 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-19488580-56b6-4615-b691-ffffb51ed85f None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:37.191043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-19488580-56b6-4615-b691-ffffb51ed85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:37.199403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1153/2273] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:37.204075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6442f-5913-474a-8842-a755cf6c10a6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.214857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6442f-5913-474a-8842-a755cf6c10a6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.219744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.220397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.220672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.220945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.221688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:37.222042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.224259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.240638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1121/2274] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:37.241926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19488580-56b6-4615-b691-ffffb51ed85f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.251658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19488580-56b6-4615-b691-ffffb51ed85f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.257356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502920-77e9-476f-b3a4-369cc86dfa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.258149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502920-77e9-476f-b3a4-369cc86dfa11 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.258465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502920-77e9-476f-b3a4-369cc86dfa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.258806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502920-77e9-476f-b3a4-369cc86dfa11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.259520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb502920-77e9-476f-b3a4-369cc86dfa11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.261518 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb502920-77e9-476f-b3a4-369cc86dfa11 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.295762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1154/2275] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:37 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:37.300339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.310979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871815-9489-4e44-a4bd-f37230c59273 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.372900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a0648-b1a8-402e-98ca-337ba7387f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.373462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a0648-b1a8-402e-98ca-337ba7387f5e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.373773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a0648-b1a8-402e-98ca-337ba7387f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.374052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a0648-b1a8-402e-98ca-337ba7387f5e admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.374694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a0648-b1a8-402e-98ca-337ba7387f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.376672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a0648-b1a8-402e-98ca-337ba7387f5e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.402727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1122/2276] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:37 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:37.404288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502920-77e9-476f-b3a4-369cc86dfa11 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.415373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502920-77e9-476f-b3a4-369cc86dfa11 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.420836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d681a-bf76-4493-adcb-fa6d4d2e201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.421822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d681a-bf76-4493-adcb-fa6d4d2e201b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.422175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d681a-bf76-4493-adcb-fa6d4d2e201b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.422426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d681a-bf76-4493-adcb-fa6d4d2e201b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.423459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d681a-bf76-4493-adcb-fa6d4d2e201b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.425393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d681a-bf76-4493-adcb-fa6d4d2e201b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.442307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1155/2277] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:37.444058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a0648-b1a8-402e-98ca-337ba7387f5e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.450853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:37.455801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a0648-b1a8-402e-98ca-337ba7387f5e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.462121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820f0b8-0eeb-44b7-9e8c-481c0a5fd02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.462821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f0b8-0eeb-44b7-9e8c-481c0a5fd02b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.463181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f0b8-0eeb-44b7-9e8c-481c0a5fd02b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.463521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f0b8-0eeb-44b7-9e8c-481c0a5fd02b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.464239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820f0b8-0eeb-44b7-9e8c-481c0a5fd02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.466433 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820f0b8-0eeb-44b7-9e8c-481c0a5fd02b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.478233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1123/2278] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:37.482637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d681a-bf76-4493-adcb-fa6d4d2e201b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.492850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d681a-bf76-4493-adcb-fa6d4d2e201b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.497581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cbea9-8dd6-4f55-9b1d-6be3cde113c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.498275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cbea9-8dd6-4f55-9b1d-6be3cde113c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.498560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cbea9-8dd6-4f55-9b1d-6be3cde113c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.498836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cbea9-8dd6-4f55-9b1d-6be3cde113c2 admin admin] PATH_INFO: `/v3/projects/9b6d760e1e42476dbcf6253f4ee44ee4/users/5d81a3a50a7745f5972240641e3faed3/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.516265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cbea9-8dd6-4f55-9b1d-6be3cde113c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6d760e1e42476dbcf6253f4ee44ee4, user_id=5d81a3a50a7745f5972240641e3faed3, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.520627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cbea9-8dd6-4f55-9b1d-6be3cde113c2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.535084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1156/2279] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:37 2022] PUT /identity/v3/projects/9b6d760e1e42476dbcf6253f4ee44ee4/users/5d81a3a50a7745f5972240641e3faed3/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:37.546623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de86fc-e977-403d-b83f-541076997329 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.546942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de86fc-e977-403d-b83f-541076997329 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.547225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de86fc-e977-403d-b83f-541076997329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.578439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-65de86fc-e977-403d-b83f-541076997329 None None] MFA Rules not processed for user `5d81a3a50a7745f5972240641e3faed3`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:37.579674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-65de86fc-e977-403d-b83f-541076997329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:37.673779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1124/2280] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:37.678842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cbea9-8dd6-4f55-9b1d-6be3cde113c2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.692376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:37.744728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cbea9-8dd6-4f55-9b1d-6be3cde113c2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.749514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.750150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.750424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.750702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.751345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.754366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.782123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1157/2281] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:37 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:37.786063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de86fc-e977-403d-b83f-541076997329 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.796921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de86fc-e977-403d-b83f-541076997329 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.839095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:37.840820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:37.873334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98906d36-67e8-469c-8b13-40d8ff125eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.874030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906d36-67e8-469c-8b13-40d8ff125eff admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.874337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906d36-67e8-469c-8b13-40d8ff125eff admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.874607 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98906d36-67e8-469c-8b13-40d8ff125eff admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.875318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98906d36-67e8-469c-8b13-40d8ff125eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.877812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98906d36-67e8-469c-8b13-40d8ff125eff admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.923082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1125/2282] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:37 2022] POST /identity/v3/users => generated 300 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:37.923082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0cdec-b77b-47f0-a1b6-485f8129b889 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.923082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0cdec-b77b-47f0-a1b6-485f8129b889 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.923082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0cdec-b77b-47f0-a1b6-485f8129b889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.947080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f037d5-da36-4e2c-b7c5-d3424301e791 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:37.953377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:37.954193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:37.954499 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:37.954763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] PATH_INFO: `/v3/users/3bd3048e39c544d48eb8875cd28e08b4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:37.956154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd3048e39c544d48eb8875cd28e08b4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:37.958380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:37.959603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-77a0cdec-b77b-47f0-a1b6-485f8129b889 None None] MFA Rules not processed for user `28d46c9f9371467fa4c37bf282f6aebb`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:37.962018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-77a0cdec-b77b-47f0-a1b6-485f8129b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:38.036471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd3048e39c544d48eb8875cd28e08b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:38.037202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd3048e39c544d48eb8875cd28e08b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:38.045418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd3048e39c544d48eb8875cd28e08b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:38.046279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd3048e39c544d48eb8875cd28e08b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:38.060088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd3048e39c544d48eb8875cd28e08b4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:38.069993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1126/2283] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:38.069993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0cdec-b77b-47f0-a1b6-485f8129b889 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.071432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-77a0cdec-b77b-47f0-a1b6-485f8129b889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:38.087900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:38.088748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1158/2284] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:37 2022] DELETE /identity/v3/users/3bd3048e39c544d48eb8875cd28e08b4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:38.089646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.091132 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:38.094939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0cdec-b77b-47f0-a1b6-485f8129b889 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.112736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:38.166442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e0768-da9e-4c4b-9e3b-42768d9fc99d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.166920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e3f51-50ee-465a-875a-a0d42debba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.167665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3f51-50ee-465a-875a-a0d42debba8f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.168001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3f51-50ee-465a-875a-a0d42debba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.168218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e3f51-50ee-465a-875a-a0d42debba8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.168872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e3f51-50ee-465a-875a-a0d42debba8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.170569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e3f51-50ee-465a-875a-a0d42debba8f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:38.171410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.172027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.172308 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.172599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.185647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1127/2285] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:38.185647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731a78-77af-4a99-8ceb-fed59a8639b7 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.186129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731a78-77af-4a99-8ceb-fed59a8639b7 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.186202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f731a78-77af-4a99-8ceb-fed59a8639b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.205040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-5f731a78-77af-4a99-8ceb-fed59a8639b7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:38.206292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5f731a78-77af-4a99-8ceb-fed59a8639b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:38.214806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1128/2286] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:38.215616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f731a78-77af-4a99-8ceb-fed59a8639b7 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.228075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f731a78-77af-4a99-8ceb-fed59a8639b7 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.233001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73298764-5eb1-40ef-9f38-a228159a8ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.233855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298764-5eb1-40ef-9f38-a228159a8ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.234313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298764-5eb1-40ef-9f38-a228159a8ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.234700 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298764-5eb1-40ef-9f38-a228159a8ca0 admin admin] PATH_INFO: `/v3/projects/8b8e5fb493b648b79b3bc257a9c5fce0/users/713be911a2914a1d809610334be9ac8e/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.239210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.240694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:38.249885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1159/2287] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:38.250540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.251856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:38.253140 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73298764-5eb1-40ef-9f38-a228159a8ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8e5fb493b648b79b3bc257a9c5fce0, user_id=713be911a2914a1d809610334be9ac8e, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.255943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73298764-5eb1-40ef-9f38-a228159a8ca0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:38.271796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1129/2288] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:38 2022] PUT /identity/v3/projects/8b8e5fb493b648b79b3bc257a9c5fce0/users/713be911a2914a1d809610334be9ac8e/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:38.276121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73298764-5eb1-40ef-9f38-a228159a8ca0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.337775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f1c43-be7d-4202-8ed1-c6042a18b06c service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.371232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73298764-5eb1-40ef-9f38-a228159a8ca0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.378391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015cb8b-3e26-4182-8d71-00ee5a33e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.379502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015cb8b-3e26-4182-8d71-00ee5a33e26f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.379792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015cb8b-3e26-4182-8d71-00ee5a33e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.380066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015cb8b-3e26-4182-8d71-00ee5a33e26f admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.381266 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015cb8b-3e26-4182-8d71-00ee5a33e26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.384187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015cb8b-3e26-4182-8d71-00ee5a33e26f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:38.396495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1130/2289] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:38.400803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015cb8b-3e26-4182-8d71-00ee5a33e26f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.403016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397194b-fb1e-4e86-bccd-79527d15ac3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.403635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397194b-fb1e-4e86-bccd-79527d15ac3c service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.403988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397194b-fb1e-4e86-bccd-79527d15ac3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.404196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397194b-fb1e-4e86-bccd-79527d15ac3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.418018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015cb8b-3e26-4182-8d71-00ee5a33e26f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.418220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397194b-fb1e-4e86-bccd-79527d15ac3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.418220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397194b-fb1e-4e86-bccd-79527d15ac3c service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:38.421098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6fa3-a53f-4ba4-8178-83e0207d7b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.421549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6fa3-a53f-4ba4-8178-83e0207d7b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.421911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6fa3-a53f-4ba4-8178-83e0207d7b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.422692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6fa3-a53f-4ba4-8178-83e0207d7b64 admin admin] PATH_INFO: `/v3/projects/8b8e5fb493b648b79b3bc257a9c5fce0/users/713be911a2914a1d809610334be9ac8e/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.425109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b6fa3-a53f-4ba4-8178-83e0207d7b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8e5fb493b648b79b3bc257a9c5fce0, user_id=713be911a2914a1d809610334be9ac8e, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.428316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b6fa3-a53f-4ba4-8178-83e0207d7b64 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:38.432018 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1160/2290] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:38.440030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1131/2291] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:38 2022] PUT /identity/v3/projects/8b8e5fb493b648b79b3bc257a9c5fce0/users/713be911a2914a1d809610334be9ac8e/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:38.451167 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f6d9-7fd5-4275-9e30-5c56b10eef70 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.451547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f6d9-7fd5-4275-9e30-5c56b10eef70 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.451827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117f6d9-7fd5-4275-9e30-5c56b10eef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.489624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9117f6d9-7fd5-4275-9e30-5c56b10eef70 None None] MFA Rules not processed for user `713be911a2914a1d809610334be9ac8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:38.491499 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9117f6d9-7fd5-4275-9e30-5c56b10eef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:38.517766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:38.621380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1161/2292] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:38.636888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6fa3-a53f-4ba4-8178-83e0207d7b64 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.737937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b6fa3-a53f-4ba4-8178-83e0207d7b64 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.743351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe33d85-d34e-4930-8298-55c95c4e319a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.744267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33d85-d34e-4930-8298-55c95c4e319a service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.744566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33d85-d34e-4930-8298-55c95c4e319a service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.744836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33d85-d34e-4930-8298-55c95c4e319a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.751441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:38.757758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe33d85-d34e-4930-8298-55c95c4e319a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.761360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe33d85-d34e-4930-8298-55c95c4e319a service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:38.775500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1132/2293] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:38.803755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117f6d9-7fd5-4275-9e30-5c56b10eef70 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.806511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9117f6d9-7fd5-4275-9e30-5c56b10eef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:38.926383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117f6d9-7fd5-4275-9e30-5c56b10eef70 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.941825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe33d85-d34e-4930-8298-55c95c4e319a service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:38.943354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.947925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.947925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.947925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] PATH_INFO: `/v3/projects/fc7a8828c90a46719952f27e652129db` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.948728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7a8828c90a46719952f27e652129db)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.951669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:38.956257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe33d85-d34e-4930-8298-55c95c4e319a service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:38.962961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:38.963688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:38.964047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:38.964229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] PATH_INFO: `/v3/users/5d81a3a50a7745f5972240641e3faed3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:38.965647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d81a3a50a7745f5972240641e3faed3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:38.967478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:39.010204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7a8828c90a46719952f27e652129db', 'request_id': 'req-676c277c-5f81-4e4b-ba77-85b39c3e562f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.018803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7a8828c90a46719952f27e652129db', 'request_id': 'req-676c277c-5f81-4e4b-ba77-85b39c3e562f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.026633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7a8828c90a46719952f27e652129db', 'request_id': 'req-676c277c-5f81-4e4b-ba77-85b39c3e562f'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.033698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d81a3a50a7745f5972240641e3faed3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.034611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d81a3a50a7745f5972240641e3faed3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.048310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] The token cache is being invalidate because project fc7a8828c90a46719952f27e652129db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:39.048680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.049548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.050268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d81a3a50a7745f5972240641e3faed3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.051883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1162/2294] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:38 2022] DELETE /identity/v3/projects/fc7a8828c90a46719952f27e652129db => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:39.056572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:39.058762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:39.060301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d81a3a50a7745f5972240641e3faed3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.098736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d81a3a50a7745f5972240641e3faed3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.127512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1133/2295] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:38 2022] DELETE /identity/v3/users/5d81a3a50a7745f5972240641e3faed3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:39.128693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:39.131465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:39.137304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:39.164876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c277c-5f81-4e4b-ba77-85b39c3e562f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:39.209638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85056fdf-52cf-4e67-8f41-3ca58f997b59 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:39.215833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:39.216620 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:39.217077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:39.217489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] PATH_INFO: `/v3/users/5d025e0bcfae4996bab1166a765d0e62` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:39.218715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d025e0bcfae4996bab1166a765d0e62)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:39.220744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:39.229763 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:39.230404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:39.230684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:39.230955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] PATH_INFO: `/v3/users/8a85f00bf72046b898edb44aabd761bd` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:39.232115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a85f00bf72046b898edb44aabd761bd)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:39.234279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:39.277224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d025e0bcfae4996bab1166a765d0e62'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.278682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d025e0bcfae4996bab1166a765d0e62'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.289468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d025e0bcfae4996bab1166a765d0e62'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.290178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d025e0bcfae4996bab1166a765d0e62'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.290965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a85f00bf72046b898edb44aabd761bd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.291829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a85f00bf72046b898edb44aabd761bd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.299798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6eb64518-c6db-4f9e-8bed-9b71bbe7b02b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d025e0bcfae4996bab1166a765d0e62'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.302197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a85f00bf72046b898edb44aabd761bd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.302915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a85f00bf72046b898edb44aabd761bd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.306064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:39.324252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1134/2296] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:39 2022] DELETE /identity/v3/users/5d025e0bcfae4996bab1166a765d0e62 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:39.325393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97477-5813-4ebc-a711-34ffe0ca9918 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:39.325709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97477-5813-4ebc-a711-34ffe0ca9918 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:39.325986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97477-5813-4ebc-a711-34ffe0ca9918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:39.327302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f1cff58a-67cb-4f57-9919-82a88ab1c399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a85f00bf72046b898edb44aabd761bd'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:39.342189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1163/2297] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:39 2022] DELETE /identity/v3/users/8a85f00bf72046b898edb44aabd761bd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:39.343845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a75e2-a390-4322-a59b-5fe1c377bf0d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:39.344142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a75e2-a390-4322-a59b-5fe1c377bf0d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:39.344405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a75e2-a390-4322-a59b-5fe1c377bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:39.366486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9bc97477-5813-4ebc-a711-34ffe0ca9918 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:39.368273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9bc97477-5813-4ebc-a711-34ffe0ca9918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:39.371456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-322a75e2-a390-4322-a59b-5fe1c377bf0d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:39.372656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-322a75e2-a390-4322-a59b-5fe1c377bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:39.456809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1164/2298] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:39.473827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1135/2299] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:39.475654 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a75e2-a390-4322-a59b-5fe1c377bf0d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:39.482170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-322a75e2-a390-4322-a59b-5fe1c377bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:39.493385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc97477-5813-4ebc-a711-34ffe0ca9918 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:39.494926 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9bc97477-5813-4ebc-a711-34ffe0ca9918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:39.497253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:39.564660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a75e2-a390-4322-a59b-5fe1c377bf0d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:39.568292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc97477-5813-4ebc-a711-34ffe0ca9918 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:39.569679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:39.570371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:39.570887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:39.571207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:39.573026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171a40-6267-47ae-9975-e8c646ee70ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:39.573665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171a40-6267-47ae-9975-e8c646ee70ed service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:39.573949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171a40-6267-47ae-9975-e8c646ee70ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:39.574222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171a40-6267-47ae-9975-e8c646ee70ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:39.583629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:39.584874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b171a40-6267-47ae-9975-e8c646ee70ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:39.585084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:39.586352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b171a40-6267-47ae-9975-e8c646ee70ed service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:39.596188 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1136/2301] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:39.596417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1165/2301] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:39.796268 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9821-a662-4528-aec3-10be91cfe473 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:39.796559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9821-a662-4528-aec3-10be91cfe473 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:39.796870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9821-a662-4528-aec3-10be91cfe473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:39.817406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a41b9821-a662-4528-aec3-10be91cfe473 None None] MFA Rules not processed for user `28d46c9f9371467fa4c37bf282f6aebb`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:39.818674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a41b9821-a662-4528-aec3-10be91cfe473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:39.880237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1137/2302] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:39.909302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:39.911758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:39.933906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda7ba6-f69c-4eb0-bf72-53a06d9f48eb service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:39.941476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:39.943024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:39.943024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:39.943024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] PATH_INFO: `/v3/projects/76548d4cab1c483eab4618f4add58025` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:39.957990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76548d4cab1c483eab4618f4add58025)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:39.962922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:39.992560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b9821-a662-4528-aec3-10be91cfe473 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:39.994177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a41b9821-a662-4528-aec3-10be91cfe473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:40.012168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b9821-a662-4528-aec3-10be91cfe473 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.025303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.026652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.027263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.027584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] PATH_INFO: `/v3/projects/9b6d760e1e42476dbcf6253f4ee44ee4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.028789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6d760e1e42476dbcf6253f4ee44ee4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.030940 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.049842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76548d4cab1c483eab4618f4add58025', 'request_id': 'req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.061760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76548d4cab1c483eab4618f4add58025', 'request_id': 'req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.069023 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76548d4cab1c483eab4618f4add58025', 'request_id': 'req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.071050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:40.089461 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] The token cache is being invalidate because project 76548d4cab1c483eab4618f4add58025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:40.089972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.090810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-42b01f0f-cc49-4e3d-ab10-9bb8f249ffa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.092717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1166/2303] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:39 2022] DELETE /identity/v3/projects/76548d4cab1c483eab4618f4add58025 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:40.096506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6d760e1e42476dbcf6253f4ee44ee4', 'request_id': 'req-a0806428-80b2-4974-8009-73789a17b265'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.098532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a757d-bf4c-4d23-9e9e-b46c2e36050c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.099020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a757d-bf4c-4d23-9e9e-b46c2e36050c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.099384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a757d-bf4c-4d23-9e9e-b46c2e36050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.112588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6d760e1e42476dbcf6253f4ee44ee4', 'request_id': 'req-a0806428-80b2-4974-8009-73789a17b265'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.120887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-679a757d-bf4c-4d23-9e9e-b46c2e36050c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:40.122258 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-679a757d-bf4c-4d23-9e9e-b46c2e36050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:40.125468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6d760e1e42476dbcf6253f4ee44ee4', 'request_id': 'req-a0806428-80b2-4974-8009-73789a17b265'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.141198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] The token cache is being invalidate because project 9b6d760e1e42476dbcf6253f4ee44ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:40.142759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.144053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.147353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1138/2304] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:39 2022] DELETE /identity/v3/projects/9b6d760e1e42476dbcf6253f4ee44ee4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:40.151051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.154684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:40.194383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1167/2305] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:40.195124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a757d-bf4c-4d23-9e9e-b46c2e36050c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.196630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-679a757d-bf4c-4d23-9e9e-b46c2e36050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:40.213544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a757d-bf4c-4d23-9e9e-b46c2e36050c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.220312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.221161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.221407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.221714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] PATH_INFO: `/v3/projects/f65b7a7b748b40c181ebe4c7ddbbf56d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.223453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65b7a7b748b40c181ebe4c7ddbbf56d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.226715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.250520 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0806428-80b2-4974-8009-73789a17b265 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.256974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.257981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.258259 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.258532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] PATH_INFO: `/v3/users/713be911a2914a1d809610334be9ac8e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.259775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713be911a2914a1d809610334be9ac8e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.261919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.272611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:40.290056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65b7a7b748b40c181ebe4c7ddbbf56d', 'request_id': 'req-6d109fd5-b734-420c-b61a-7842443d8615'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.297517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65b7a7b748b40c181ebe4c7ddbbf56d', 'request_id': 'req-6d109fd5-b734-420c-b61a-7842443d8615'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.305563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65b7a7b748b40c181ebe4c7ddbbf56d', 'request_id': 'req-6d109fd5-b734-420c-b61a-7842443d8615'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.321002 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] The token cache is being invalidate because project f65b7a7b748b40c181ebe4c7ddbbf56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:40.321228 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.321850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6d109fd5-b734-420c-b61a-7842443d8615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.323299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1168/2306] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:40 2022] DELETE /identity/v3/projects/f65b7a7b748b40c181ebe4c7ddbbf56d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:40.324503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4368e-98d6-4214-80a7-42ef9e6d10bb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.324808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4368e-98d6-4214-80a7-42ef9e6d10bb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.325065 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4368e-98d6-4214-80a7-42ef9e6d10bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.326628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713be911a2914a1d809610334be9ac8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.327431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713be911a2914a1d809610334be9ac8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.337441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713be911a2914a1d809610334be9ac8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.338143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713be911a2914a1d809610334be9ac8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.346817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c412a5f7-c95c-486f-b7a6-2ca6ec228044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713be911a2914a1d809610334be9ac8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:40.347835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-19f4368e-98d6-4214-80a7-42ef9e6d10bb None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:40.349147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-19f4368e-98d6-4214-80a7-42ef9e6d10bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:40.365690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1139/2307] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:40 2022] DELETE /identity/v3/users/713be911a2914a1d809610334be9ac8e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:50:40.366928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028b0e-cb07-4638-a05b-b1fbf35f6ac5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.367211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028b0e-cb07-4638-a05b-b1fbf35f6ac5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.367480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97028b0e-cb07-4638-a05b-b1fbf35f6ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.388673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-97028b0e-cb07-4638-a05b-b1fbf35f6ac5 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:40.389963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-97028b0e-cb07-4638-a05b-b1fbf35f6ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:40.423190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:40.423804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1169/2308] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:40.429445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4368e-98d6-4214-80a7-42ef9e6d10bb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.447642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4368e-98d6-4214-80a7-42ef9e6d10bb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.469524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1140/2309] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:40.477813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701565a-b658-4877-9958-ee852d043277 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.495301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701565a-b658-4877-9958-ee852d043277 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.495593 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701565a-b658-4877-9958-ee852d043277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.536521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7701565a-b658-4877-9958-ee852d043277 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:40.538039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7701565a-b658-4877-9958-ee852d043277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:40.563349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1141/2310] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:40.568633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701565a-b658-4877-9958-ee852d043277 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.578993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701565a-b658-4877-9958-ee852d043277 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.585091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.585932 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.586316 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.586801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.587613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:40.588011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.590349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.593484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.594385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.595997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.597136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.598047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:40.598674 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.609765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.614246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1142/2311] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 12:50:40.618300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.629760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1170/2312] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:40.633930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.634971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a65ebf-9eb8-483c-bc50-a25eefc7353e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.645344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808929-c70d-493a-9bff-f81bcc4e46cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.646226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808929-c70d-493a-9bff-f81bcc4e46cc admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.646660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808929-c70d-493a-9bff-f81bcc4e46cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.647142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808929-c70d-493a-9bff-f81bcc4e46cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.648015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808929-c70d-493a-9bff-f81bcc4e46cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.650200 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808929-c70d-493a-9bff-f81bcc4e46cc admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.650326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e917-b6d1-4db2-95c6-a6eeb7f64198 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.657179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04617e4-c744-44ac-8d04-3a0dc10dd029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.657447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04617e4-c744-44ac-8d04-3a0dc10dd029 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.657766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04617e4-c744-44ac-8d04-3a0dc10dd029 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.658109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04617e4-c744-44ac-8d04-3a0dc10dd029 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.658677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04617e4-c744-44ac-8d04-3a0dc10dd029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.660641 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04617e4-c744-44ac-8d04-3a0dc10dd029 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.687893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1143/2313] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:40 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:40.692645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808929-c70d-493a-9bff-f81bcc4e46cc admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.712133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1171/2314] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:40 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:40.715621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04617e4-c744-44ac-8d04-3a0dc10dd029 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.808457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808929-c70d-493a-9bff-f81bcc4e46cc admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.815816 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:40.895157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04617e4-c744-44ac-8d04-3a0dc10dd029 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.903765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.904405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.905348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.905811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.906775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.909932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.942966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0b8d-07c8-4c36-ba18-c7cc850b81ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.944025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0b8d-07c8-4c36-ba18-c7cc850b81ef admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.944318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0b8d-07c8-4c36-ba18-c7cc850b81ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.944594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0b8d-07c8-4c36-ba18-c7cc850b81ef admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.945380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c0b8d-07c8-4c36-ba18-c7cc850b81ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.945490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1172/2315] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:40 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:40.946363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.947450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c0b8d-07c8-4c36-ba18-c7cc850b81ef admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.948274 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:40.961663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb57392-2979-4612-bec4-e1b9cce7c330 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:40.969438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:40.970462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:40.970813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:40.971084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] PATH_INFO: `/v3/projects/8b8e5fb493b648b79b3bc257a9c5fce0` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:40.972245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8e5fb493b648b79b3bc257a9c5fce0)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:40.976288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:40.982403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1144/2316] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:40 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:40.984183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0b8d-07c8-4c36-ba18-c7cc850b81ef admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:40.998172 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0b8d-07c8-4c36-ba18-c7cc850b81ef admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.003329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af1ad-253a-4b55-9725-451498dbdc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.005185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af1ad-253a-4b55-9725-451498dbdc6d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.005548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af1ad-253a-4b55-9725-451498dbdc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.006362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af1ad-253a-4b55-9725-451498dbdc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.007096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1af1ad-253a-4b55-9725-451498dbdc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.008801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1af1ad-253a-4b55-9725-451498dbdc6d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.024158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1145/2317] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:41.024158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af1ad-253a-4b55-9725-451498dbdc6d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.038343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af1ad-253a-4b55-9725-451498dbdc6d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.039334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8e5fb493b648b79b3bc257a9c5fce0', 'request_id': 'req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:41.048337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8e5fb493b648b79b3bc257a9c5fce0', 'request_id': 'req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:41.066710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:41.069534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8e5fb493b648b79b3bc257a9c5fce0', 'request_id': 'req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:41.097299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] The token cache is being invalidate because project 8b8e5fb493b648b79b3bc257a9c5fce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:41.097867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:41.099260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:41.103330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1173/2318] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:40 2022] DELETE /identity/v3/projects/8b8e5fb493b648b79b3bc257a9c5fce0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:41.104382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.106367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:41.139660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82e59c-b5f0-4af8-8658-ced6f1349bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.139953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e59c-b5f0-4af8-8658-ced6f1349bde admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.140240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e59c-b5f0-4af8-8658-ced6f1349bde admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.140517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82e59c-b5f0-4af8-8658-ced6f1349bde admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.143758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82e59c-b5f0-4af8-8658-ced6f1349bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.146638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82e59c-b5f0-4af8-8658-ced6f1349bde admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.170319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1146/2319] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:41.172038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6c95-a358-4685-a628-b07aa8c8356b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.172330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6c95-a358-4685-a628-b07aa8c8356b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.172614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6c95-a358-4685-a628-b07aa8c8356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.195714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9cfc6c95-a358-4685-a628-b07aa8c8356b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:41.197161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9cfc6c95-a358-4685-a628-b07aa8c8356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:41.206696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1147/2320] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:41.208338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6c95-a358-4685-a628-b07aa8c8356b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.210090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9cfc6c95-a358-4685-a628-b07aa8c8356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:41.211914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8b793-ac55-4e25-8d8a-bfaa795ef20b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.222137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a672f1e-b111-4b05-b33f-6226581e989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.223062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a672f1e-b111-4b05-b33f-6226581e989b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.223435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a672f1e-b111-4b05-b33f-6226581e989b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.223870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a672f1e-b111-4b05-b33f-6226581e989b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.224578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a672f1e-b111-4b05-b33f-6226581e989b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.224897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6c95-a358-4685-a628-b07aa8c8356b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.226220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a672f1e-b111-4b05-b33f-6226581e989b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.230302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cae41-1675-467e-ab7e-c4e912f50990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.230980 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cae41-1675-467e-ab7e-c4e912f50990 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.231297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cae41-1675-467e-ab7e-c4e912f50990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.231575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cae41-1675-467e-ab7e-c4e912f50990 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.232341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cae41-1675-467e-ab7e-c4e912f50990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.234219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cae41-1675-467e-ab7e-c4e912f50990 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.239860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1174/2321] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:41.241277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9cad0-c37d-41e5-a191-fc6beda29359 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.241846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9cad0-c37d-41e5-a191-fc6beda29359 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.242059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9cad0-c37d-41e5-a191-fc6beda29359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.249179 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1148/2322] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:41.253255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cae41-1675-467e-ab7e-c4e912f50990 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.264454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cae41-1675-467e-ab7e-c4e912f50990 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.266209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3da9cad0-c37d-41e5-a191-fc6beda29359 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:41.267735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3da9cad0-c37d-41e5-a191-fc6beda29359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:41.270566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ea451-30a9-4544-aa30-1a1b92934612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.271246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ea451-30a9-4544-aa30-1a1b92934612 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.271531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ea451-30a9-4544-aa30-1a1b92934612 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.271810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ea451-30a9-4544-aa30-1a1b92934612 admin admin] PATH_INFO: `/v3/projects/b128dfaf1ae049ee88c103504039d6b9/users/1e464087c35640d2a33fba1dfb948c96/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.277494 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1175/2323] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:41.278542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9cad0-c37d-41e5-a191-fc6beda29359 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.290192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9cad0-c37d-41e5-a191-fc6beda29359 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.295212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ea451-30a9-4544-aa30-1a1b92934612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b128dfaf1ae049ee88c103504039d6b9, user_id=1e464087c35640d2a33fba1dfb948c96, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.296516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee37198-6762-4193-b905-1c634261c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.297360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee37198-6762-4193-b905-1c634261c331 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.297686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee37198-6762-4193-b905-1c634261c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.297969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee37198-6762-4193-b905-1c634261c331 admin admin] PATH_INFO: `/v3/projects/24c3e59419104bf9a195068ae8fb9f9e/users/c863e3f54924416092066c64f7ae3585/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.299386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ea451-30a9-4544-aa30-1a1b92934612 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.319365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee37198-6762-4193-b905-1c634261c331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c3e59419104bf9a195068ae8fb9f9e, user_id=c863e3f54924416092066c64f7ae3585, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.322804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee37198-6762-4193-b905-1c634261c331 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.329721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1149/2324] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:41 2022] PUT /identity/v3/projects/b128dfaf1ae049ee88c103504039d6b9/users/1e464087c35640d2a33fba1dfb948c96/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:41.329721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ea451-30a9-4544-aa30-1a1b92934612 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.349913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1176/2325] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:41 2022] PUT /identity/v3/projects/24c3e59419104bf9a195068ae8fb9f9e/users/c863e3f54924416092066c64f7ae3585/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:41.351361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da396f-ec81-4d49-a73e-cdbd166c2723 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.351656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da396f-ec81-4d49-a73e-cdbd166c2723 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.351933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da396f-ec81-4d49-a73e-cdbd166c2723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.382714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:41.392585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-68da396f-ec81-4d49-a73e-cdbd166c2723 None None] MFA Rules not processed for user `1e464087c35640d2a33fba1dfb948c96`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:41.395687 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-68da396f-ec81-4d49-a73e-cdbd166c2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:41.451340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ea451-30a9-4544-aa30-1a1b92934612 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.500800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1177/2326] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:41.504556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d33dee-4938-4898-8221-90845c3fa59a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.505111 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d33dee-4938-4898-8221-90845c3fa59a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.505854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d33dee-4938-4898-8221-90845c3fa59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.540048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.541750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.542106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.542384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.542523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-78d33dee-4938-4898-8221-90845c3fa59a None None] MFA Rules not processed for user `c863e3f54924416092066c64f7ae3585`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:41.543049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:41.543361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.544672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-78d33dee-4938-4898-8221-90845c3fa59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:41.545010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.563224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1150/2327] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:41.564292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.566982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:41.594429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:41.634774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1178/2328] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:41.635715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d33dee-4938-4898-8221-90845c3fa59a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.649614 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d33dee-4938-4898-8221-90845c3fa59a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.654709 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4be88-b6bf-4fa4-9de7-11b3142c7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.655391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4be88-b6bf-4fa4-9de7-11b3142c7112 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.655678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4be88-b6bf-4fa4-9de7-11b3142c7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.655949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4be88-b6bf-4fa4-9de7-11b3142c7112 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.656583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4be88-b6bf-4fa4-9de7-11b3142c7112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.658672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4be88-b6bf-4fa4-9de7-11b3142c7112 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.660152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11777d2f-d4a6-48b7-aecf-678af5f737e8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.664063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.664695 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.665079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.665279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.674406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.676580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.686883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1151/2329] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:41.687737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.689302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:41.701888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721d3c8-57f5-40c9-8853-e7726cb6394b service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.705969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86bcc5-7bd0-4d3f-b05f-ac5e1ccbaea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.706762 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86bcc5-7bd0-4d3f-b05f-ac5e1ccbaea7 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.707048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86bcc5-7bd0-4d3f-b05f-ac5e1ccbaea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.707326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86bcc5-7bd0-4d3f-b05f-ac5e1ccbaea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.708226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1179/2330] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:41 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:41.713210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4be88-b6bf-4fa4-9de7-11b3142c7112 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.720872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86bcc5-7bd0-4d3f-b05f-ac5e1ccbaea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.723063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86bcc5-7bd0-4d3f-b05f-ac5e1ccbaea7 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.733783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1152/2331] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:41.788837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4be88-b6bf-4fa4-9de7-11b3142c7112 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.794480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50448b6-334a-4b2b-84fe-206e3e28b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.795109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50448b6-334a-4b2b-84fe-206e3e28b639 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.795392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50448b6-334a-4b2b-84fe-206e3e28b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.795669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50448b6-334a-4b2b-84fe-206e3e28b639 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.796311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50448b6-334a-4b2b-84fe-206e3e28b639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.798635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50448b6-334a-4b2b-84fe-206e3e28b639 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.823283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:41.832885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1180/2332] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:41 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:50:41.836640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86bcc5-7bd0-4d3f-b05f-ac5e1ccbaea7 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.848021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86bcc5-7bd0-4d3f-b05f-ac5e1ccbaea7 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.855503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9a005-42c7-4be7-9a1c-e2adadd46dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.857260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9a005-42c7-4be7-9a1c-e2adadd46dad admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.857954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9a005-42c7-4be7-9a1c-e2adadd46dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.858359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9a005-42c7-4be7-9a1c-e2adadd46dad admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.859755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9a005-42c7-4be7-9a1c-e2adadd46dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.862860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9a005-42c7-4be7-9a1c-e2adadd46dad admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.885977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1153/2333] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:41.889630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50448b6-334a-4b2b-84fe-206e3e28b639 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.913774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50448b6-334a-4b2b-84fe-206e3e28b639 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:41.926813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e28b43-96ed-42d5-b998-6cb9304d2fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:41.927867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e28b43-96ed-42d5-b998-6cb9304d2fce admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:41.928501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e28b43-96ed-42d5-b998-6cb9304d2fce admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:41.933729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e28b43-96ed-42d5-b998-6cb9304d2fce admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:41.936162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e28b43-96ed-42d5-b998-6cb9304d2fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:41.938336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e28b43-96ed-42d5-b998-6cb9304d2fce admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:41.973494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9a005-42c7-4be7-9a1c-e2adadd46dad admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:41.977980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1181/2334] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:41.992580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9a005-42c7-4be7-9a1c-e2adadd46dad admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:42.006998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529083b0-eb12-4337-a0cd-35500409804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:42.011062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529083b0-eb12-4337-a0cd-35500409804b admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:42.011062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529083b0-eb12-4337-a0cd-35500409804b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:42.012371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529083b0-eb12-4337-a0cd-35500409804b admin admin] PATH_INFO: `/v3/projects/7bb5b3552bac4e66a74f0629e5d31579/users/ba77c833b2f646e59d0a9d2b02c68802/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:42.051197 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529083b0-eb12-4337-a0cd-35500409804b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb5b3552bac4e66a74f0629e5d31579, user_id=ba77c833b2f646e59d0a9d2b02c68802, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:42.055284 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529083b0-eb12-4337-a0cd-35500409804b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:42.078278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1154/2335] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:41 2022] PUT /identity/v3/projects/7bb5b3552bac4e66a74f0629e5d31579/users/ba77c833b2f646e59d0a9d2b02c68802/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:42.089790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee602-e8cc-4234-92aa-acf62dfa232e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:42.090224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee602-e8cc-4234-92aa-acf62dfa232e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:42.090424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee602-e8cc-4234-92aa-acf62dfa232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:42.137878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-37cee602-e8cc-4234-92aa-acf62dfa232e None None] MFA Rules not processed for user `ba77c833b2f646e59d0a9d2b02c68802`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:42.142608 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-37cee602-e8cc-4234-92aa-acf62dfa232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:42.231824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1182/2336] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:42.243621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529083b0-eb12-4337-a0cd-35500409804b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:42.309243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529083b0-eb12-4337-a0cd-35500409804b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:42.315721 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e13bdf-0abe-4a26-a258-af371e9a4f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:42.316613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e13bdf-0abe-4a26-a258-af371e9a4f4e service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:42.317001 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e13bdf-0abe-4a26-a258-af371e9a4f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:42.317347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e13bdf-0abe-4a26-a258-af371e9a4f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:42.339055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e13bdf-0abe-4a26-a258-af371e9a4f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:42.340670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e13bdf-0abe-4a26-a258-af371e9a4f4e service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:42.353386 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1155/2337] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:45.460803 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee602-e8cc-4234-92aa-acf62dfa232e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:45.526667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee602-e8cc-4234-92aa-acf62dfa232e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:45.531133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:45.532010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:45.532124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:45.532478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] PATH_INFO: `/v3/users/1e464087c35640d2a33fba1dfb948c96` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:45.533758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e464087c35640d2a33fba1dfb948c96)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:45.535758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:45.595801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e464087c35640d2a33fba1dfb948c96'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:45.597120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e464087c35640d2a33fba1dfb948c96'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:45.605522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e464087c35640d2a33fba1dfb948c96'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:45.614911 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e464087c35640d2a33fba1dfb948c96'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:45.630046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e464087c35640d2a33fba1dfb948c96'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:45.634129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:45.648892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1183/2338] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:45 2022] DELETE /identity/v3/users/1e464087c35640d2a33fba1dfb948c96 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:45.653849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700313-6d54-474f-9dd5-6bd214e93cdf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:45.654816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700313-6d54-474f-9dd5-6bd214e93cdf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:45.655112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700313-6d54-474f-9dd5-6bd214e93cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:45.677482 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c0700313-6d54-474f-9dd5-6bd214e93cdf None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:45.678729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c0700313-6d54-474f-9dd5-6bd214e93cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:45.765332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1156/2339] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:45.776390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:45.778673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:45.854215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4282-11ad-4b04-aa32-d205a55aef2e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:45.860129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcba63-fad2-40c5-85e4-3fbe3da1fbd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:45.860844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcba63-fad2-40c5-85e4-3fbe3da1fbd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:45.861226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcba63-fad2-40c5-85e4-3fbe3da1fbd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:45.861568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcba63-fad2-40c5-85e4-3fbe3da1fbd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:45.875348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcba63-fad2-40c5-85e4-3fbe3da1fbd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:45.876825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcba63-fad2-40c5-85e4-3fbe3da1fbd0 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:45.892986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1184/2340] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:46.270053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0700313-6d54-474f-9dd5-6bd214e93cdf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:46.273036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c0700313-6d54-474f-9dd5-6bd214e93cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:46.288595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0700313-6d54-474f-9dd5-6bd214e93cdf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:46.293474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:46.294161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.294446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.294724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] PATH_INFO: `/v3/projects/b128dfaf1ae049ee88c103504039d6b9` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.295862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b128dfaf1ae049ee88c103504039d6b9)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:46.299084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:46.309384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:46.352914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b128dfaf1ae049ee88c103504039d6b9', 'request_id': 'req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:46.359081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b128dfaf1ae049ee88c103504039d6b9', 'request_id': 'req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:46.367683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b128dfaf1ae049ee88c103504039d6b9', 'request_id': 'req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:46.379378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] The token cache is being invalidate because project b128dfaf1ae049ee88c103504039d6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:46.379672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:46.380346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c5d47a4-d306-490e-bd5e-8e8d69fb0a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:46.381891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1157/2341] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:46 2022] DELETE /identity/v3/projects/b128dfaf1ae049ee88c103504039d6b9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:46.386654 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca751-f300-458a-ad8b-15b8cbba6487 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.386960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca751-f300-458a-ad8b-15b8cbba6487 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.387234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca751-f300-458a-ad8b-15b8cbba6487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.408225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-eb5ca751-f300-458a-ad8b-15b8cbba6487 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:46.409427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-eb5ca751-f300-458a-ad8b-15b8cbba6487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:46.475628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1185/2342] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:46.484585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607304b-1765-4c74-8c92-3d9979912757 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.484875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607304b-1765-4c74-8c92-3d9979912757 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.485154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607304b-1765-4c74-8c92-3d9979912757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.509918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1607304b-1765-4c74-8c92-3d9979912757 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:46.511134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1607304b-1765-4c74-8c92-3d9979912757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:46.519405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1158/2343] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:46.523989 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca751-f300-458a-ad8b-15b8cbba6487 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:46.534257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca751-f300-458a-ad8b-15b8cbba6487 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:46.540034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:46.541941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.541941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.541941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.541941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:46.542377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:46.543722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:46.561475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1186/2344] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:46.563775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607304b-1765-4c74-8c92-3d9979912757 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:46.574105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607304b-1765-4c74-8c92-3d9979912757 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:46.581325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf14e-cefd-4d53-8726-4274c8adfd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:46.582542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf14e-cefd-4d53-8726-4274c8adfd5a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.582849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf14e-cefd-4d53-8726-4274c8adfd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.583121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbf14e-cefd-4d53-8726-4274c8adfd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.583779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbf14e-cefd-4d53-8726-4274c8adfd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:46.585784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbf14e-cefd-4d53-8726-4274c8adfd5a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:46.618872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1159/2345] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:46 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:46.623117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:46.634185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a3b1-7032-42cb-b795-cd25db3b13e8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:46.700221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735779f8-fed3-4227-aa79-6f413417e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:46.700851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735779f8-fed3-4227-aa79-6f413417e1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.701185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735779f8-fed3-4227-aa79-6f413417e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.701462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735779f8-fed3-4227-aa79-6f413417e1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.702145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735779f8-fed3-4227-aa79-6f413417e1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:46.704201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735779f8-fed3-4227-aa79-6f413417e1a5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:46.728272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1187/2346] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:46 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:46.732670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf14e-cefd-4d53-8726-4274c8adfd5a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:46.743982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbf14e-cefd-4d53-8726-4274c8adfd5a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:46.748782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4aee-ecaf-4de7-b656-30698f769434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:46.749520 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4aee-ecaf-4de7-b656-30698f769434 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.750046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4aee-ecaf-4de7-b656-30698f769434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.750525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a4aee-ecaf-4de7-b656-30698f769434 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.751218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a4aee-ecaf-4de7-b656-30698f769434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:46.752895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a4aee-ecaf-4de7-b656-30698f769434 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:46.764381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1160/2347] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:50:46.771025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735779f8-fed3-4227-aa79-6f413417e1a5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:46.781414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735779f8-fed3-4227-aa79-6f413417e1a5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:46.787409 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b10c8e-77b9-423b-b022-62db8d925fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:46.788031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b10c8e-77b9-423b-b022-62db8d925fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.788317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b10c8e-77b9-423b-b022-62db8d925fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.788612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b10c8e-77b9-423b-b022-62db8d925fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.789252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b10c8e-77b9-423b-b022-62db8d925fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:46.791153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b10c8e-77b9-423b-b022-62db8d925fb4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:46.802952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1188/2348] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:46.813271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4aee-ecaf-4de7-b656-30698f769434 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:46.823889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a4aee-ecaf-4de7-b656-30698f769434 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:46.828784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:46.829457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.829776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.830478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] PATH_INFO: `/v3/projects/180ecc8ffc4743a182e1d21f8d5444d0/users/11979753c72544e1b956c6c99aedb53d/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.852050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] RBAC: Authorizing `identity:create_grant(project_id=180ecc8ffc4743a182e1d21f8d5444d0, user_id=11979753c72544e1b956c6c99aedb53d, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:46.855021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:46.872419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1161/2349] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:46 2022] PUT /identity/v3/projects/180ecc8ffc4743a182e1d21f8d5444d0/users/11979753c72544e1b956c6c99aedb53d/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:46.877416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978a834-7768-4fbf-bb48-948f2c9d3b47 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:46.877617 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978a834-7768-4fbf-bb48-948f2c9d3b47 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:46.877904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978a834-7768-4fbf-bb48-948f2c9d3b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:46.889548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:46.924676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d978a834-7768-4fbf-bb48-948f2c9d3b47 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:46.926072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d978a834-7768-4fbf-bb48-948f2c9d3b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:47.014963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1189/2350] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:47.026844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:47.028959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:47.112115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a211dd2-a9ef-4f95-b45c-efec31f0054c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:47.116711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa84a4-db93-44ca-aed3-bf7457c0a8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:47.117204 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa84a4-db93-44ca-aed3-bf7457c0a8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:47.117483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa84a4-db93-44ca-aed3-bf7457c0a8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:47.117790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa84a4-db93-44ca-aed3-bf7457c0a8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:47.129456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa84a4-db93-44ca-aed3-bf7457c0a8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:47.131112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa84a4-db93-44ca-aed3-bf7457c0a8c2 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:47.145581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1162/2351] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:48.111773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978a834-7768-4fbf-bb48-948f2c9d3b47 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:48.113410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d978a834-7768-4fbf-bb48-948f2c9d3b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:48.130703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978a834-7768-4fbf-bb48-948f2c9d3b47 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:48.136469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:48.137371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:48.137903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:48.138459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] PATH_INFO: `/v3/users/ba77c833b2f646e59d0a9d2b02c68802` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:48.139818 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba77c833b2f646e59d0a9d2b02c68802)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:48.142265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:48.215329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba77c833b2f646e59d0a9d2b02c68802'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:48.216176 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba77c833b2f646e59d0a9d2b02c68802'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:48.225264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba77c833b2f646e59d0a9d2b02c68802'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:48.226159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba77c833b2f646e59d0a9d2b02c68802'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:48.241372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9be3a40-76fc-428b-b437-e248e3ee5202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba77c833b2f646e59d0a9d2b02c68802'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:48.261944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e3369-335c-428b-a49a-214e8fee786f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:48.262927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e3369-335c-428b-a49a-214e8fee786f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:48.263369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e3369-335c-428b-a49a-214e8fee786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:48.266876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1190/2352] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:48 2022] DELETE /identity/v3/users/ba77c833b2f646e59d0a9d2b02c68802 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:48.272103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0f5a9-ea1e-47ff-ac68-8f140ac69a70 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:48.272392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0f5a9-ea1e-47ff-ac68-8f140ac69a70 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:48.272725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0f5a9-ea1e-47ff-ac68-8f140ac69a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:48.299933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-099e3369-335c-428b-a49a-214e8fee786f None None] MFA Rules not processed for user `11979753c72544e1b956c6c99aedb53d`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:48.301187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1db0f5a9-ea1e-47ff-ac68-8f140ac69a70 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:48.301814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-099e3369-335c-428b-a49a-214e8fee786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:48.302438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1db0f5a9-ea1e-47ff-ac68-8f140ac69a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:48.336539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:48.388465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1191/2353] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:48.401273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0f5a9-ea1e-47ff-ac68-8f140ac69a70 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:48.403441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1db0f5a9-ea1e-47ff-ac68-8f140ac69a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:48.413123 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1163/2354] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:48.427096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e3369-335c-428b-a49a-214e8fee786f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:48.428785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-099e3369-335c-428b-a49a-214e8fee786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:48.443269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:48.529041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e3369-335c-428b-a49a-214e8fee786f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:48.534351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:48.536134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:48.536564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:48.536942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:48.543322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0f5a9-ea1e-47ff-ac68-8f140ac69a70 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:48.547403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a74ee5-01c7-436d-88a9-fb7d4a8d7feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:48.548037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a74ee5-01c7-436d-88a9-fb7d4a8d7feb service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:48.548315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a74ee5-01c7-436d-88a9-fb7d4a8d7feb service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:48.548620 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a74ee5-01c7-436d-88a9-fb7d4a8d7feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:48.551684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:48.553810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:48.561043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a74ee5-01c7-436d-88a9-fb7d4a8d7feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:48.568642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1164/2355] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:48.570020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a74ee5-01c7-436d-88a9-fb7d4a8d7feb service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:48.589084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1192/2356] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:50:49.107225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:49.108905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:49.142464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a07658-0ed8-4b7d-9e42-6eb86e04f7e5 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:49.149786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:49.150646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.151007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.151414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] PATH_INFO: `/v3/projects/7bb5b3552bac4e66a74f0629e5d31579` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.152772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb5b3552bac4e66a74f0629e5d31579)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:49.161653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:49.244637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb5b3552bac4e66a74f0629e5d31579', 'request_id': 'req-91b5157c-dfd6-42b5-846f-1413151141ce'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:49.252686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb5b3552bac4e66a74f0629e5d31579', 'request_id': 'req-91b5157c-dfd6-42b5-846f-1413151141ce'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:49.265548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb5b3552bac4e66a74f0629e5d31579', 'request_id': 'req-91b5157c-dfd6-42b5-846f-1413151141ce'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:49.289500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] The token cache is being invalidate because project 7bb5b3552bac4e66a74f0629e5d31579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:49.290115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:49.291054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-91b5157c-dfd6-42b5-846f-1413151141ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:49.298004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1165/2357] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:49 2022] DELETE /identity/v3/projects/7bb5b3552bac4e66a74f0629e5d31579 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:49.300860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ad0c-73e9-4220-b447-ee28812c1fe1 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.302199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ad0c-73e9-4220-b447-ee28812c1fe1 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.302519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ad0c-73e9-4220-b447-ee28812c1fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.324315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c6e2ad0c-73e9-4220-b447-ee28812c1fe1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:49.325636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c6e2ad0c-73e9-4220-b447-ee28812c1fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:49.400482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1193/2358] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:49.409401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9edc33-0a8c-4f84-b18a-c5d4520f60cd None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.410379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9edc33-0a8c-4f84-b18a-c5d4520f60cd None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.410659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9edc33-0a8c-4f84-b18a-c5d4520f60cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.440400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-df9edc33-0a8c-4f84-b18a-c5d4520f60cd None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:49.441953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-df9edc33-0a8c-4f84-b18a-c5d4520f60cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:49.456771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1166/2359] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:49.457885 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2ad0c-73e9-4220-b447-ee28812c1fe1 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:49.468379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2ad0c-73e9-4220-b447-ee28812c1fe1 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:49.474529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:49.475143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.475467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.475698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.476356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:50:49.476872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:49.479419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:49.494969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1194/2360] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:50:49.499562 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9edc33-0a8c-4f84-b18a-c5d4520f60cd None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:49.509126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9edc33-0a8c-4f84-b18a-c5d4520f60cd None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:49.513943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dc002-8cf7-4459-b91f-4e9d08a0ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:49.514572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dc002-8cf7-4459-b91f-4e9d08a0ea5f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.514850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dc002-8cf7-4459-b91f-4e9d08a0ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.515125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dc002-8cf7-4459-b91f-4e9d08a0ea5f admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.515756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dc002-8cf7-4459-b91f-4e9d08a0ea5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:49.517751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dc002-8cf7-4459-b91f-4e9d08a0ea5f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:49.546185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1167/2361] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:50:49 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:49.551188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:49.562504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa28e78-ecf8-40a5-b253-5cb3be065a62 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:49.625245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8b7c4-8b19-484b-9714-4c625c4c640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:49.625958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b7c4-8b19-484b-9714-4c625c4c640c admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.626238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b7c4-8b19-484b-9714-4c625c4c640c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.626508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b7c4-8b19-484b-9714-4c625c4c640c admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.627143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8b7c4-8b19-484b-9714-4c625c4c640c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:49.629109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8b7c4-8b19-484b-9714-4c625c4c640c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:49.653082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1195/2362] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:50:49 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:50:49.657450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dc002-8cf7-4459-b91f-4e9d08a0ea5f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:49.670052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dc002-8cf7-4459-b91f-4e9d08a0ea5f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:49.675312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393083f8-7495-4807-ba8e-4cfa4944a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:49.675883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393083f8-7495-4807-ba8e-4cfa4944a129 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.676168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393083f8-7495-4807-ba8e-4cfa4944a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.676443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393083f8-7495-4807-ba8e-4cfa4944a129 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.677085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393083f8-7495-4807-ba8e-4cfa4944a129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:49.678741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393083f8-7495-4807-ba8e-4cfa4944a129 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:49.689703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1168/2363] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:49.694010 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8b7c4-8b19-484b-9714-4c625c4c640c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:49.703889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8b7c4-8b19-484b-9714-4c625c4c640c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:49.709115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7995c3-9265-4508-a6e8-32dcf2f1955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:49.709746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7995c3-9265-4508-a6e8-32dcf2f1955b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.710028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7995c3-9265-4508-a6e8-32dcf2f1955b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.710297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7995c3-9265-4508-a6e8-32dcf2f1955b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.710996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7995c3-9265-4508-a6e8-32dcf2f1955b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:49.712626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7995c3-9265-4508-a6e8-32dcf2f1955b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:49.726406 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1196/2364] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:50:49.730723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393083f8-7495-4807-ba8e-4cfa4944a129 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:49.741117 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393083f8-7495-4807-ba8e-4cfa4944a129 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:49.747082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:49.747750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.748033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.748308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] PATH_INFO: `/v3/projects/c31e56a45b724831a7b4bdbe8dde8ad8/users/2547edd93f2649bab73d21a4cc71cb10/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.757199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:49.764089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31e56a45b724831a7b4bdbe8dde8ad8, user_id=2547edd93f2649bab73d21a4cc71cb10, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:49.767364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:49.783112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1169/2365] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:50:49 2022] PUT /identity/v3/projects/c31e56a45b724831a7b4bdbe8dde8ad8/users/2547edd93f2649bab73d21a4cc71cb10/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:49.794024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52704-37ef-41eb-bd93-670eae7177b5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.794309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52704-37ef-41eb-bd93-670eae7177b5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.794583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52704-37ef-41eb-bd93-670eae7177b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.821741 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e9e52704-37ef-41eb-bd93-670eae7177b5 None None] MFA Rules not processed for user `2547edd93f2649bab73d21a4cc71cb10`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:49.822956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e9e52704-37ef-41eb-bd93-670eae7177b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:49.836001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:49.906260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1197/2366] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:49.918578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:49.923513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:49.982471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb766451-46c4-43a0-ace3-120fb25ac4db admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:49.986333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:49.987020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:49.987370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:49.987737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:49.997757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:49.999180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:50.009344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1170/2367] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:50.152360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945347-a98c-4f26-a35c-5a37e8d093ec None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:50.152732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945347-a98c-4f26-a35c-5a37e8d093ec None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:50.153011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945347-a98c-4f26-a35c-5a37e8d093ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:50.173101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-52945347-a98c-4f26-a35c-5a37e8d093ec None None] MFA Rules not processed for user `11979753c72544e1b956c6c99aedb53d`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:50.174240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-52945347-a98c-4f26-a35c-5a37e8d093ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:50.233470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1198/2368] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:50:52.859068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:52.860486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:52.929399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe65c3-6f6e-4ec8-8a85-12d6795f5a32 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:52.933829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:52.934457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:52.934733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:52.935006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] PATH_INFO: `/v3/users/c863e3f54924416092066c64f7ae3585` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:52.936107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c863e3f54924416092066c64f7ae3585)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:52.939541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:52.991145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c863e3f54924416092066c64f7ae3585'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:52.992247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c863e3f54924416092066c64f7ae3585'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:53.002206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c863e3f54924416092066c64f7ae3585'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:53.002816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c863e3f54924416092066c64f7ae3585'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:53.009952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c863e3f54924416092066c64f7ae3585'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:53.027536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1171/2369] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:50:52 2022] DELETE /identity/v3/users/c863e3f54924416092066c64f7ae3585 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:50:53.031422 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779e492-f9ba-41ce-a7e4-ea56ce19d84c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:53.031929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779e492-f9ba-41ce-a7e4-ea56ce19d84c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:53.032025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779e492-f9ba-41ce-a7e4-ea56ce19d84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:53.052882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d779e492-f9ba-41ce-a7e4-ea56ce19d84c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:50:53.054178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d779e492-f9ba-41ce-a7e4-ea56ce19d84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:53.168336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1199/2370] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:50:53.179116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:53.180640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:53.199474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:53.316178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab4650-978d-406f-848c-e08e4810b0b4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:53.322901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f18677-ab13-4a58-a43b-594332106ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:53.323592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f18677-ab13-4a58-a43b-594332106ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:53.323942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f18677-ab13-4a58-a43b-594332106ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:53.324287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f18677-ab13-4a58-a43b-594332106ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:53.335683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f18677-ab13-4a58-a43b-594332106ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:53.337263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f18677-ab13-4a58-a43b-594332106ed8 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:53.348224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1172/2371] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:50:54.054291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779e492-f9ba-41ce-a7e4-ea56ce19d84c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:50:54.055915 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d779e492-f9ba-41ce-a7e4-ea56ce19d84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:50:54.068088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779e492-f9ba-41ce-a7e4-ea56ce19d84c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:50:54.073225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:50:54.073879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:50:54.074352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:50:54.074632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] PATH_INFO: `/v3/projects/24c3e59419104bf9a195068ae8fb9f9e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:50:54.075822 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c3e59419104bf9a195068ae8fb9f9e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:50:54.077825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:50:54.140626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c3e59419104bf9a195068ae8fb9f9e', 'request_id': 'req-1c85e80c-6c19-4438-83b3-068262609aa0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:54.146830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:50:54.148393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c3e59419104bf9a195068ae8fb9f9e', 'request_id': 'req-1c85e80c-6c19-4438-83b3-068262609aa0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:54.155603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c3e59419104bf9a195068ae8fb9f9e', 'request_id': 'req-1c85e80c-6c19-4438-83b3-068262609aa0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:54.171805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] The token cache is being invalidate because project 24c3e59419104bf9a195068ae8fb9f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:50:54.172102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:54.172792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1c85e80c-6c19-4438-83b3-068262609aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:50:54.175157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1200/2372] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:50:54 2022] DELETE /identity/v3/projects/24c3e59419104bf9a195068ae8fb9f9e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:51:03.343010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=22 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:04.167949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:10.495203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ac39-ec4d-400e-941f-d4d40d4d6ba0 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:10.495710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ac39-ec4d-400e-941f-d4d40d4d6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:10.495807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ac39-ec4d-400e-941f-d4d40d4d6ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:10.517699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f9d5ac39-ec4d-400e-941f-d4d40d4d6ba0 None None] MFA Rules not processed for user `c1309821469549fe82a2c419ef4434d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:10.519083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f9d5ac39-ec4d-400e-941f-d4d40d4d6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:10.582443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1173/2373] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:51:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:11.314393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64184f3b-365a-4416-a58c-5f9764763dea None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:11.314884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64184f3b-365a-4416-a58c-5f9764763dea None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:11.315152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64184f3b-365a-4416-a58c-5f9764763dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:11.344129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-64184f3b-365a-4416-a58c-5f9764763dea None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:11.345533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-64184f3b-365a-4416-a58c-5f9764763dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:11.456344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1201/2374] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:51:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:11.465723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ac39-ec4d-400e-941f-d4d40d4d6ba0 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:11.469303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f9d5ac39-ec4d-400e-941f-d4d40d4d6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:11.592196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ac39-ec4d-400e-941f-d4d40d4d6ba0 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:11.606294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84801bba-bb51-4e92-810c-193b3d19d50b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:11.607126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801bba-bb51-4e92-810c-193b3d19d50b service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:11.607544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801bba-bb51-4e92-810c-193b3d19d50b service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:11.607952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84801bba-bb51-4e92-810c-193b3d19d50b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:11.629667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84801bba-bb51-4e92-810c-193b3d19d50b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:11.631524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84801bba-bb51-4e92-810c-193b3d19d50b service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:11.641232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1174/2375] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:51:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:51:12.190361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c012-168e-4b26-a5ee-c80f7b1e4209 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:12.190650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c012-168e-4b26-a5ee-c80f7b1e4209 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:12.190942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7c012-168e-4b26-a5ee-c80f7b1e4209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:12.212862 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-48f7c012-168e-4b26-a5ee-c80f7b1e4209 None None] MFA Rules not processed for user `11979753c72544e1b956c6c99aedb53d`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:12.214389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-48f7c012-168e-4b26-a5ee-c80f7b1e4209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:12.307371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1202/2376] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:51:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:21.638223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=57 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:22.299148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=50 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:24.227191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482684d-6fff-4284-adba-b6346234cc95 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:24.227769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482684d-6fff-4284-adba-b6346234cc95 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:24.227888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482684d-6fff-4284-adba-b6346234cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:24.249364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a482684d-6fff-4284-adba-b6346234cc95 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:24.250612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a482684d-6fff-4284-adba-b6346234cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:24.313238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1175/2377] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:24.340855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c012-168e-4b26-a5ee-c80f7b1e4209 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:24.342728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-48f7c012-168e-4b26-a5ee-c80f7b1e4209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:24.427181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7c012-168e-4b26-a5ee-c80f7b1e4209 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:24.437186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b18d5-a716-4908-8364-b3520f6d4e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:24.438579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b18d5-a716-4908-8364-b3520f6d4e8b service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:24.438579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b18d5-a716-4908-8364-b3520f6d4e8b service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:24.438579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b18d5-a716-4908-8364-b3520f6d4e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:24.449105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b18d5-a716-4908-8364-b3520f6d4e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:24.450920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b18d5-a716-4908-8364-b3520f6d4e8b service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:24.461752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1203/2378] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:51:27.924434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482684d-6fff-4284-adba-b6346234cc95 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:27.926722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a482684d-6fff-4284-adba-b6346234cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:27.938484 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482684d-6fff-4284-adba-b6346234cc95 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:27.943909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:27.944548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:27.944829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:27.945134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] PATH_INFO: `/v3/users/2547edd93f2649bab73d21a4cc71cb10` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:27.946254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2547edd93f2649bab73d21a4cc71cb10)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:27.948225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:28.011154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2547edd93f2649bab73d21a4cc71cb10'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.011822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2547edd93f2649bab73d21a4cc71cb10'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.020084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2547edd93f2649bab73d21a4cc71cb10'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.020850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2547edd93f2649bab73d21a4cc71cb10'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.028567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2547edd93f2649bab73d21a4cc71cb10'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.046110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1176/2379] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:51:27 2022] DELETE /identity/v3/users/2547edd93f2649bab73d21a4cc71cb10 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:51:28.051137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c856e-63df-4995-a3eb-393eb09f9898 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:28.051609 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c856e-63df-4995-a3eb-393eb09f9898 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:28.051922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c856e-63df-4995-a3eb-393eb09f9898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:28.072126 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-173c856e-63df-4995-a3eb-393eb09f9898 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:28.073488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-173c856e-63df-4995-a3eb-393eb09f9898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:28.139905 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1204/2380] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:28.149816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:28.151613 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:28.223554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b131f1-31f7-4e89-a14f-4c960fd34d57 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:28.227338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ade2b-d41e-4941-b37d-4343f8bad763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:28.228006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ade2b-d41e-4941-b37d-4343f8bad763 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:28.228276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ade2b-d41e-4941-b37d-4343f8bad763 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:28.228551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ade2b-d41e-4941-b37d-4343f8bad763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:28.240054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ade2b-d41e-4941-b37d-4343f8bad763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:28.241665 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ade2b-d41e-4941-b37d-4343f8bad763 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:28.252047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1177/2381] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:51:28.638955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c856e-63df-4995-a3eb-393eb09f9898 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:28.641088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-173c856e-63df-4995-a3eb-393eb09f9898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:28.655313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c856e-63df-4995-a3eb-393eb09f9898 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:28.661290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:28.661965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:28.662248 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:28.662520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] PATH_INFO: `/v3/projects/c31e56a45b724831a7b4bdbe8dde8ad8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:28.663663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31e56a45b724831a7b4bdbe8dde8ad8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:28.665585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:28.715834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31e56a45b724831a7b4bdbe8dde8ad8', 'request_id': 'req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.722761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31e56a45b724831a7b4bdbe8dde8ad8', 'request_id': 'req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.729571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31e56a45b724831a7b4bdbe8dde8ad8', 'request_id': 'req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.744088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] The token cache is being invalidate because project c31e56a45b724831a7b4bdbe8dde8ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:51:28.744381 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.745082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-90ec439d-80fa-4bfa-bcaa-f7c97620fa6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:28.746661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1205/2382] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:51:28 2022] DELETE /identity/v3/projects/c31e56a45b724831a7b4bdbe8dde8ad8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:51:28.752192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2b06f-fb45-4e74-adc9-d07e6487b6c1 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:28.752588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2b06f-fb45-4e74-adc9-d07e6487b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:28.752874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2b06f-fb45-4e74-adc9-d07e6487b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:28.779128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3ca2b06f-fb45-4e74-adc9-d07e6487b6c1 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:28.781169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3ca2b06f-fb45-4e74-adc9-d07e6487b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:28.794710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:28.869241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f575ea-a61c-443a-acf1-de87539705a3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:28.869582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f575ea-a61c-443a-acf1-de87539705a3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:28.869715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1178/2383] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:28.869835 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f575ea-a61c-443a-acf1-de87539705a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:28.899249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-40f575ea-a61c-443a-acf1-de87539705a3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:28.900478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-40f575ea-a61c-443a-acf1-de87539705a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:28.909418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1206/2384] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:28.914106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2b06f-fb45-4e74-adc9-d07e6487b6c1 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:28.926219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2b06f-fb45-4e74-adc9-d07e6487b6c1 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:28.931803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:28.932436 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:28.932723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:28.933002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:28.933859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:51:28.934171 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:28.935798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:28.955264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f575ea-a61c-443a-acf1-de87539705a3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:28.955508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1179/2385] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:51:28.960883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:28.967604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f575ea-a61c-443a-acf1-de87539705a3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:28.977487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323802a-b668-42fd-818f-e88372185e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:28.978854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323802a-b668-42fd-818f-e88372185e36 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:28.979333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323802a-b668-42fd-818f-e88372185e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:28.979676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323802a-b668-42fd-818f-e88372185e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:28.980747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323802a-b668-42fd-818f-e88372185e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:28.984435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323802a-b668-42fd-818f-e88372185e36 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:29.043196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1207/2386] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:51:28 2022] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:51:29.047883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:29.073843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c540b-5188-4823-bc13-b3a3d9477afe admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:29.215325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925f39e-f744-44a1-9eb4-94272211c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:29.215955 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925f39e-f744-44a1-9eb4-94272211c656 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:29.217783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925f39e-f744-44a1-9eb4-94272211c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:29.217783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925f39e-f744-44a1-9eb4-94272211c656 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:29.217783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925f39e-f744-44a1-9eb4-94272211c656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:29.219318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925f39e-f744-44a1-9eb4-94272211c656 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:29.259910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1180/2387] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:51:29 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:51:29.262888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323802a-b668-42fd-818f-e88372185e36 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:29.282289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323802a-b668-42fd-818f-e88372185e36 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:29.293913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40494d-192d-4d9f-934e-11fc588ca82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:29.294905 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40494d-192d-4d9f-934e-11fc588ca82a admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:29.295368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40494d-192d-4d9f-934e-11fc588ca82a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:29.303982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40494d-192d-4d9f-934e-11fc588ca82a admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:29.305471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40494d-192d-4d9f-934e-11fc588ca82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:29.310028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40494d-192d-4d9f-934e-11fc588ca82a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:29.328157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1208/2388] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:51:29.328836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925f39e-f744-44a1-9eb4-94272211c656 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:29.343521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925f39e-f744-44a1-9eb4-94272211c656 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:29.358651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678f7a1-c903-4293-b592-30ba8d0869d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:29.359361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678f7a1-c903-4293-b592-30ba8d0869d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:29.359654 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678f7a1-c903-4293-b592-30ba8d0869d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:29.359929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678f7a1-c903-4293-b592-30ba8d0869d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:29.360598 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678f7a1-c903-4293-b592-30ba8d0869d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:29.363214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678f7a1-c903-4293-b592-30ba8d0869d3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:29.385636 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1181/2389] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:51:29.390179 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40494d-192d-4d9f-934e-11fc588ca82a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:29.405102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40494d-192d-4d9f-934e-11fc588ca82a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:29.411182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492441b-5574-442d-8cea-2dd6d3306fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:29.411931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492441b-5574-442d-8cea-2dd6d3306fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:29.412227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492441b-5574-442d-8cea-2dd6d3306fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:29.412511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492441b-5574-442d-8cea-2dd6d3306fe9 admin admin] PATH_INFO: `/v3/projects/5d8148162d314d78966463f95d571807/users/d943d78e1245435ba4dda9646fdf3536/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:29.438336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492441b-5574-442d-8cea-2dd6d3306fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8148162d314d78966463f95d571807, user_id=d943d78e1245435ba4dda9646fdf3536, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:29.447556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492441b-5574-442d-8cea-2dd6d3306fe9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:29.470723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1209/2390] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:51:29 2022] PUT /identity/v3/projects/5d8148162d314d78966463f95d571807/users/d943d78e1245435ba4dda9646fdf3536/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:51:29.481077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1399bc-05b5-4ab3-8ce1-52f48c069e52 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:29.481365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1399bc-05b5-4ab3-8ce1-52f48c069e52 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:29.481672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1399bc-05b5-4ab3-8ce1-52f48c069e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:29.520840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ab1399bc-05b5-4ab3-8ce1-52f48c069e52 None None] MFA Rules not processed for user `d943d78e1245435ba4dda9646fdf3536`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:29.522310 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ab1399bc-05b5-4ab3-8ce1-52f48c069e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:29.559538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764d41-a89e-44bc-951e-b9ec3fb0cd9a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:29.559746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764d41-a89e-44bc-951e-b9ec3fb0cd9a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:29.560036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764d41-a89e-44bc-951e-b9ec3fb0cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:29.602200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-aa764d41-a89e-44bc-951e-b9ec3fb0cd9a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:29.603434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-aa764d41-a89e-44bc-951e-b9ec3fb0cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:29.642780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1182/2391] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:29.656534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1399bc-05b5-4ab3-8ce1-52f48c069e52 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:29.658120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ab1399bc-05b5-4ab3-8ce1-52f48c069e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:29.686440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:29.712903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1210/2392] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:51:29.730897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764d41-a89e-44bc-951e-b9ec3fb0cd9a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:29.744161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-aa764d41-a89e-44bc-951e-b9ec3fb0cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:29.792413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1399bc-05b5-4ab3-8ce1-52f48c069e52 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:29.801984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1370e-1721-4c6b-8c2d-29abe451f8f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:29.803462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1370e-1721-4c6b-8c2d-29abe451f8f4 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:29.803752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1370e-1721-4c6b-8c2d-29abe451f8f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:29.804030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1370e-1721-4c6b-8c2d-29abe451f8f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:29.816294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1370e-1721-4c6b-8c2d-29abe451f8f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:29.819378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1370e-1721-4c6b-8c2d-29abe451f8f4 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:29.833462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1183/2393] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:51:29.878404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764d41-a89e-44bc-951e-b9ec3fb0cd9a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:29.885629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c258e1-e0b2-48f2-ac99-49668b511feb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:29.887193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c258e1-e0b2-48f2-ac99-49668b511feb service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:29.887354 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c258e1-e0b2-48f2-ac99-49668b511feb service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:29.887757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c258e1-e0b2-48f2-ac99-49668b511feb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:29.898726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c258e1-e0b2-48f2-ac99-49668b511feb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:29.900521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c258e1-e0b2-48f2-ac99-49668b511feb service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:29.941901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1211/2394] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:51:33.386254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8eb6-7eb1-46ca-b002-1393b716b9a2 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.386821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8eb6-7eb1-46ca-b002-1393b716b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.386922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf8eb6-7eb1-46ca-b002-1393b716b9a2 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.389219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1184/2395] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:51:33.396426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5ef9-7935-49cc-abc2-2e707241bd86 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.397016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5ef9-7935-49cc-abc2-2e707241bd86 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.397109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5ef9-7935-49cc-abc2-2e707241bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.417919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-da7f5ef9-7935-49cc-abc2-2e707241bd86 None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:33.419268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-da7f5ef9-7935-49cc-abc2-2e707241bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:33.433029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1212/2396] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:33.445392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8eb6-7eb1-46ca-b002-1393b716b9a2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:33.447142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e9bf8eb6-7eb1-46ca-b002-1393b716b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:33.511070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf8eb6-7eb1-46ca-b002-1393b716b9a2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:33.514689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031a61b-7194-4c2f-9992-7bb859b62984 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdb8a57a383c475caff51c3d6d5c6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:33.515315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a61b-7194-4c2f-9992-7bb859b62984 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.515595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a61b-7194-4c2f-9992-7bb859b62984 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.515867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a61b-7194-4c2f-9992-7bb859b62984 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.527194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a61b-7194-4c2f-9992-7bb859b62984 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:33.528629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031a61b-7194-4c2f-9992-7bb859b62984 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:33.539290 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1185/2397] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:51:33.612201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9bab-3444-4090-baa0-23016379bfcc None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.612201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9bab-3444-4090-baa0-23016379bfcc None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.612555 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9bab-3444-4090-baa0-23016379bfcc None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.613986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1213/2398] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 12:51:33.618730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf23b5-c388-4e17-83ad-cb8cfd1f2c84 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.619089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf23b5-c388-4e17-83ad-cb8cfd1f2c84 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.619379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf23b5-c388-4e17-83ad-cb8cfd1f2c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.639785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-97bf23b5-c388-4e17-83ad-cb8cfd1f2c84 None None] MFA Rules not processed for user `3e1d9844633a4afaacbb1867b8bbe582`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:33.641003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-97bf23b5-c388-4e17-83ad-cb8cfd1f2c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:33.696084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1186/2399] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:33.708392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d9bab-3444-4090-baa0-23016379bfcc None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:33.710168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-965d9bab-3444-4090-baa0-23016379bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:33.723310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d9bab-3444-4090-baa0-23016379bfcc None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:33.726798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fb66c-7550-42f2-9a4a-d84fdbb1f7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:33.727393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb66c-7550-42f2-9a4a-d84fdbb1f7ab service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.727666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb66c-7550-42f2-9a4a-d84fdbb1f7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.727932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb66c-7550-42f2-9a4a-d84fdbb1f7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.735141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fb66c-7550-42f2-9a4a-d84fdbb1f7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:33.736566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fb66c-7550-42f2-9a4a-d84fdbb1f7ab service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:33.752181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1214/2400] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:51:33.841850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941057a-fbb2-414b-a357-941f137836a4 None None] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.842167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941057a-fbb2-414b-a357-941f137836a4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.842470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941057a-fbb2-414b-a357-941f137836a4 None None] PATH_INFO: `/` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.843979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1187/2401] 10.222.0.30 () {54 vars in 921 bytes} [Tue Oct 4 12:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 12:51:33.849534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71569-3ad6-4b6b-9b3a-dc4467848429 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.849847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71569-3ad6-4b6b-9b3a-dc4467848429 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.850457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71569-3ad6-4b6b-9b3a-dc4467848429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.870894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-adb71569-3ad6-4b6b-9b3a-dc4467848429 None None] MFA Rules not processed for user `175bb8ec9ccf487bb6e11f37bec82cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:33.871841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-adb71569-3ad6-4b6b-9b3a-dc4467848429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:33.882715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1215/2402] 10.222.0.30 () {58 vars in 1018 bytes} [Tue Oct 4 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:33.893466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941057a-fbb2-414b-a357-941f137836a4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:33.905349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941057a-fbb2-414b-a357-941f137836a4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:33.909936 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ffe6c-8921-4f23-bd48-8b10a2e5d6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:33.910597 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffe6c-8921-4f23-bd48-8b10a2e5d6bc service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:33.910972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffe6c-8921-4f23-bd48-8b10a2e5d6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:33.911363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ffe6c-8921-4f23-bd48-8b10a2e5d6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:33.930397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ffe6c-8921-4f23-bd48-8b10a2e5d6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:33.931892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ffe6c-8921-4f23-bd48-8b10a2e5d6bc service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:33.943666 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1188/2403] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:51:34.822284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ab4e-b0c1-428f-a22f-12f5b6c93055 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:34.822834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ab4e-b0c1-428f-a22f-12f5b6c93055 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:34.822834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ab4e-b0c1-428f-a22f-12f5b6c93055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:34.831412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:34.842977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-43e6ab4e-b0c1-428f-a22f-12f5b6c93055 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:34.844189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-43e6ab4e-b0c1-428f-a22f-12f5b6c93055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:34.852224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1216/2404] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:34.867977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ffe6c-8921-4f23-bd48-8b10a2e5d6bc service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:34.879576 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ffe6c-8921-4f23-bd48-8b10a2e5d6bc service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:34.885360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d323d-d4e5-497f-b72d-1ba0fa9cd764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:34.886004 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d323d-d4e5-497f-b72d-1ba0fa9cd764 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:34.886278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d323d-d4e5-497f-b72d-1ba0fa9cd764 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:34.886552 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d323d-d4e5-497f-b72d-1ba0fa9cd764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:34.894987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d323d-d4e5-497f-b72d-1ba0fa9cd764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:34.896568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d323d-d4e5-497f-b72d-1ba0fa9cd764 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:34.905866 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1189/2405] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:51:40.006067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390786c-09f3-4353-aee5-93690fdc9f00 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:40.006575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390786c-09f3-4353-aee5-93690fdc9f00 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:40.006689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390786c-09f3-4353-aee5-93690fdc9f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:40.026420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8390786c-09f3-4353-aee5-93690fdc9f00 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:40.027661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8390786c-09f3-4353-aee5-93690fdc9f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:40.036809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1217/2406] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:40.062617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d323d-d4e5-497f-b72d-1ba0fa9cd764 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:40.074367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d323d-d4e5-497f-b72d-1ba0fa9cd764 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:40.082458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b105a-0f39-4761-bc35-ced9aab08436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:40.083755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b105a-0f39-4761-bc35-ced9aab08436 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:40.084086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b105a-0f39-4761-bc35-ced9aab08436 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:40.084401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b105a-0f39-4761-bc35-ced9aab08436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:40.095554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b105a-0f39-4761-bc35-ced9aab08436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:40.098622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b105a-0f39-4761-bc35-ced9aab08436 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:40.109190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1190/2407] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:51:40.177892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390786c-09f3-4353-aee5-93690fdc9f00 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:40.192447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390786c-09f3-4353-aee5-93690fdc9f00 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:40.199984 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:40.200968 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:40.201253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:40.201519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] PATH_INFO: `/v3/users/d943d78e1245435ba4dda9646fdf3536` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:40.202774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=d943d78e1245435ba4dda9646fdf3536)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:40.204731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:40.259719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd943d78e1245435ba4dda9646fdf3536'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.260427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd943d78e1245435ba4dda9646fdf3536'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.267603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd943d78e1245435ba4dda9646fdf3536'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.268332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd943d78e1245435ba4dda9646fdf3536'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.281162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd943d78e1245435ba4dda9646fdf3536'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.295190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1218/2408] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:51:40 2022] DELETE /identity/v3/users/d943d78e1245435ba4dda9646fdf3536 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:51:40.301516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafe54b-ab70-4b68-bae7-9af2b4cb61fb None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:40.302070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafe54b-ab70-4b68-bae7-9af2b4cb61fb None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:40.302628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafe54b-ab70-4b68-bae7-9af2b4cb61fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:40.328065 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0aafe54b-ab70-4b68-bae7-9af2b4cb61fb None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:40.329666 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0aafe54b-ab70-4b68-bae7-9af2b4cb61fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:40.349977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:40.390013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1191/2409] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:40.401028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:40.402604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:40.460360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72536f-d0df-4163-bc6b-1b0fbdae6ece admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:40.464073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b1df9-5a52-4455-8418-a00590679270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:40.464684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1df9-5a52-4455-8418-a00590679270 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:40.464965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1df9-5a52-4455-8418-a00590679270 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:40.465240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b1df9-5a52-4455-8418-a00590679270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:40.474350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b1df9-5a52-4455-8418-a00590679270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:40.475777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b1df9-5a52-4455-8418-a00590679270 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:40.485410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1219/2410] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:51:40.834933 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafe54b-ab70-4b68-bae7-9af2b4cb61fb None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:40.836474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0aafe54b-ab70-4b68-bae7-9af2b4cb61fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:40.848758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafe54b-ab70-4b68-bae7-9af2b4cb61fb None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:40.854544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:40.855348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:40.856026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:40.856323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] PATH_INFO: `/v3/projects/5d8148162d314d78966463f95d571807` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:40.857510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8148162d314d78966463f95d571807)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:40.861060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:40.916038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8148162d314d78966463f95d571807', 'request_id': 'req-c5951556-13e0-4e31-9c61-04eb692b9c30'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.922508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8148162d314d78966463f95d571807', 'request_id': 'req-c5951556-13e0-4e31-9c61-04eb692b9c30'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.932255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8148162d314d78966463f95d571807', 'request_id': 'req-c5951556-13e0-4e31-9c61-04eb692b9c30'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.945804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] The token cache is being invalidate because project 5d8148162d314d78966463f95d571807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:51:40.946104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.946842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:51:40.950565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1192/2411] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:51:40 2022] DELETE /identity/v3/projects/5d8148162d314d78966463f95d571807 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:51:41.970546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e3e5-84c8-48f0-9e40-27a1b31ae2bf None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:41.971249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e3e5-84c8-48f0-9e40-27a1b31ae2bf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:41.971249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e3e5-84c8-48f0-9e40-27a1b31ae2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:41.991182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-45d5e3e5-84c8-48f0-9e40-27a1b31ae2bf None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:41.992384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-45d5e3e5-84c8-48f0-9e40-27a1b31ae2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:42.054505 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1220/2412] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:51:42.075724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:42.077120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:42.144655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5951556-13e0-4e31-9c61-04eb692b9c30 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:42.149557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3e473-ee64-4e2d-be25-a9b410a69e0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:42.150270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3e473-ee64-4e2d-be25-a9b410a69e0d service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:42.150491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3e473-ee64-4e2d-be25-a9b410a69e0d service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:42.150758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3e473-ee64-4e2d-be25-a9b410a69e0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:42.160752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3e473-ee64-4e2d-be25-a9b410a69e0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:42.162489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3e473-ee64-4e2d-be25-a9b410a69e0d service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:42.170927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1193/2413] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:51:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:51:42.622058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b8c1-dae0-46c0-a20c-ee250caf0cac None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:42.622348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b8c1-dae0-46c0-a20c-ee250caf0cac None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:42.622622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b8c1-dae0-46c0-a20c-ee250caf0cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:42.644705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d355b8c1-dae0-46c0-a20c-ee250caf0cac None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:42.645956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d355b8c1-dae0-46c0-a20c-ee250caf0cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:42.653376 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1221/2414] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:51:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:42.666937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3e473-ee64-4e2d-be25-a9b410a69e0d service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:42.679007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3e473-ee64-4e2d-be25-a9b410a69e0d service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:42.699902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:42.700538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:42.700822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:42.701101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:42.713051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:42.714701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:42.723377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1194/2415] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:51:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:51:43.248686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903356a9-a125-4c70-a2ad-5baa7f8f00a7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:43.250123 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903356a9-a125-4c70-a2ad-5baa7f8f00a7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:43.250559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903356a9-a125-4c70-a2ad-5baa7f8f00a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:43.268372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:43.290660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-903356a9-a125-4c70-a2ad-5baa7f8f00a7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:43.292825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-903356a9-a125-4c70-a2ad-5baa7f8f00a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:43.382590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1222/2416] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:43.403672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:43.406002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:43.470555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:43.543325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608aa24-6f36-4e57-bfce-64d6397ecc29 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:43.549398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e553c9-a979-48f9-bdf6-e7f726a6eea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:43.550411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e553c9-a979-48f9-bdf6-e7f726a6eea4 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:43.550770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e553c9-a979-48f9-bdf6-e7f726a6eea4 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:43.551184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e553c9-a979-48f9-bdf6-e7f726a6eea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:43.561130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e553c9-a979-48f9-bdf6-e7f726a6eea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:43.562893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e553c9-a979-48f9-bdf6-e7f726a6eea4 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:43.575283 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1195/2417] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:51:53.373163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=25 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:53.570331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=22 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:51:58.621887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fbc8-96cb-4d80-a324-57912c90bf38 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:58.622392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fbc8-96cb-4d80-a324-57912c90bf38 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:58.622498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5fbc8-96cb-4d80-a324-57912c90bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:58.641229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0cb5fbc8-96cb-4d80-a324-57912c90bf38 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:58.642458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0cb5fbc8-96cb-4d80-a324-57912c90bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:51:58.650347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1223/2418] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 4 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:51:58.663102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e553c9-a979-48f9-bdf6-e7f726a6eea4 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:51:58.674438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e553c9-a979-48f9-bdf6-e7f726a6eea4 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:51:58.680144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:51:58.680755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:58.681034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:58.681309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:58.689349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:51:58.691578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:51:58.699429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1196/2419] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:51:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:51:59.971404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a060-6fb2-4b49-b744-2aa43f15a1bd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:51:59.971948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a060-6fb2-4b49-b744-2aa43f15a1bd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:51:59.972046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193a060-6fb2-4b49-b744-2aa43f15a1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:51:59.991407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a193a060-6fb2-4b49-b744-2aa43f15a1bd None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:51:59.992612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a193a060-6fb2-4b49-b744-2aa43f15a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:00.000435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1224/2420] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:52:00.015516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:00.017037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:00.033928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb429415-0561-482d-acd0-c9523c8bdc21 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:00.039421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9750af8-1880-4d57-b7bb-60e4080b6ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:00.040086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750af8-1880-4d57-b7bb-60e4080b6ca6 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:00.040418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750af8-1880-4d57-b7bb-60e4080b6ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:00.040732 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9750af8-1880-4d57-b7bb-60e4080b6ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:00.050093 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9750af8-1880-4d57-b7bb-60e4080b6ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:00.051874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9750af8-1880-4d57-b7bb-60e4080b6ca6 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:00.062050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1197/2421] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:52:00.630855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193a060-6fb2-4b49-b744-2aa43f15a1bd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:00.632408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a193a060-6fb2-4b49-b744-2aa43f15a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:00.646775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193a060-6fb2-4b49-b744-2aa43f15a1bd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:00.651661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:00.652520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:00.652868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:00.653231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] PATH_INFO: `/v3/users/11979753c72544e1b956c6c99aedb53d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:00.654585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11979753c72544e1b956c6c99aedb53d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:00.656617 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:00.710086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11979753c72544e1b956c6c99aedb53d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:00.710682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11979753c72544e1b956c6c99aedb53d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:00.721108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11979753c72544e1b956c6c99aedb53d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:00.722372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11979753c72544e1b956c6c99aedb53d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:00.734545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b42b6485-fa20-47df-8252-e0c4c7db6f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11979753c72544e1b956c6c99aedb53d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:00.749055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1225/2422] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:52:00 2022] DELETE /identity/v3/users/11979753c72544e1b956c6c99aedb53d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:52:00.922359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9750af8-1880-4d57-b7bb-60e4080b6ca6 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:00.932503 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9750af8-1880-4d57-b7bb-60e4080b6ca6 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:00.992275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:00.992913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:00.993194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:00.993470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] PATH_INFO: `/v3/projects/180ecc8ffc4743a182e1d21f8d5444d0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:00.994698 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180ecc8ffc4743a182e1d21f8d5444d0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:00.996616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:01.042907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180ecc8ffc4743a182e1d21f8d5444d0', 'request_id': 'req-04796901-8b20-4083-9ca2-2046d2413431'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:01.048450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180ecc8ffc4743a182e1d21f8d5444d0', 'request_id': 'req-04796901-8b20-4083-9ca2-2046d2413431'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:01.055878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180ecc8ffc4743a182e1d21f8d5444d0', 'request_id': 'req-04796901-8b20-4083-9ca2-2046d2413431'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:01.068587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] The token cache is being invalidate because project 180ecc8ffc4743a182e1d21f8d5444d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:52:01.068881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:01.069520 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:52:01.071096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1198/2423] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:52:00 2022] DELETE /identity/v3/projects/180ecc8ffc4743a182e1d21f8d5444d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:52:02.214379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a5404-9ffe-48b1-a6f7-1f85913d8071 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:02.215501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a5404-9ffe-48b1-a6f7-1f85913d8071 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:02.216297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a5404-9ffe-48b1-a6f7-1f85913d8071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:02.239704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1d3a5404-9ffe-48b1-a6f7-1f85913d8071 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:02.241024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1d3a5404-9ffe-48b1-a6f7-1f85913d8071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:02.297997 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1226/2424] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 4 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:02.310736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:02.312120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:02.382020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04796901-8b20-4083-9ca2-2046d2413431 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:02.386905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b140ff-2865-42e6-ade0-e25dc1b5d526 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:02.387509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b140ff-2865-42e6-ade0-e25dc1b5d526 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:02.387792 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b140ff-2865-42e6-ade0-e25dc1b5d526 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:02.388067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b140ff-2865-42e6-ade0-e25dc1b5d526 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:02.392951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:52:02.398097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b140ff-2865-42e6-ade0-e25dc1b5d526 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:02.400075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b140ff-2865-42e6-ade0-e25dc1b5d526 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:02.409843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1199/2425] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:52:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:52:11.470732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a5404-9ffe-48b1-a6f7-1f85913d8071 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:11.473291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1d3a5404-9ffe-48b1-a6f7-1f85913d8071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:11.550453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a5404-9ffe-48b1-a6f7-1f85913d8071 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:11.555434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c3596-0bc9-4e11-934c-74f3d1f7f27b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:11.556045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c3596-0bc9-4e11-934c-74f3d1f7f27b service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:11.556327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c3596-0bc9-4e11-934c-74f3d1f7f27b service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:11.556603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c3596-0bc9-4e11-934c-74f3d1f7f27b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:11.558319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e34c3596-0bc9-4e11-934c-74f3d1f7f27b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:11.566344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:52:11.571602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c3596-0bc9-4e11-934c-74f3d1f7f27b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:11.574664 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c3596-0bc9-4e11-934c-74f3d1f7f27b service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:11.586617 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1227/2426] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:52:12.406529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:52:17.364557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2de610-8af2-4d93-8fdc-3c91b1bb5121 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:17.365189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2de610-8af2-4d93-8fdc-3c91b1bb5121 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:17.365189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2de610-8af2-4d93-8fdc-3c91b1bb5121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:17.383357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-de2de610-8af2-4d93-8fdc-3c91b1bb5121 None None] MFA Rules not processed for user `28d46c9f9371467fa4c37bf282f6aebb`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:17.384546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-de2de610-8af2-4d93-8fdc-3c91b1bb5121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:17.443256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1200/2427] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:21.581648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:52:27.436360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=25 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:52:30.181297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6cb23-6fcc-43a1-86a1-d0167cbb797c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:30.181870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6cb23-6fcc-43a1-86a1-d0167cbb797c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:30.181870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6cb23-6fcc-43a1-86a1-d0167cbb797c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:30.201857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9fa6cb23-6fcc-43a1-86a1-d0167cbb797c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:30.203102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9fa6cb23-6fcc-43a1-86a1-d0167cbb797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:30.260908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1228/2428] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:30.277746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2de610-8af2-4d93-8fdc-3c91b1bb5121 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:30.279171 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-de2de610-8af2-4d93-8fdc-3c91b1bb5121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:30.350417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2de610-8af2-4d93-8fdc-3c91b1bb5121 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:30.355822 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd93c-7dc1-453a-8291-101286d191ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:30.356428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd93c-7dc1-453a-8291-101286d191ea service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:30.356711 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd93c-7dc1-453a-8291-101286d191ea service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:30.356987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bd93c-7dc1-453a-8291-101286d191ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:30.365471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bd93c-7dc1-453a-8291-101286d191ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:30.367084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bd93c-7dc1-453a-8291-101286d191ea service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:30.376365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1201/2429] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:52:33.460304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e0b0e-26a4-42fe-93b8-559da2b3d9e2 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:33.460839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e0b0e-26a4-42fe-93b8-559da2b3d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:33.460956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e0b0e-26a4-42fe-93b8-559da2b3d9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:33.480683 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e12e0b0e-26a4-42fe-93b8-559da2b3d9e2 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:33.481908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e12e0b0e-26a4-42fe-93b8-559da2b3d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:33.490276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1229/2430] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:33.506318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd93c-7dc1-453a-8291-101286d191ea service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:33.517385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bd93c-7dc1-453a-8291-101286d191ea service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:33.523236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647796de-7149-427e-b6d9-ea52e30944bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:33.523833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647796de-7149-427e-b6d9-ea52e30944bd service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:33.524116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647796de-7149-427e-b6d9-ea52e30944bd service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:33.524391 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647796de-7149-427e-b6d9-ea52e30944bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:33.532282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647796de-7149-427e-b6d9-ea52e30944bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:33.533905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647796de-7149-427e-b6d9-ea52e30944bd service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:33.543573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1202/2431] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:52:36.545942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c177e-5714-4be2-a421-33d0b919e527 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:36.546347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c177e-5714-4be2-a421-33d0b919e527 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:36.546499 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c177e-5714-4be2-a421-33d0b919e527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:36.565986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-490c177e-5714-4be2-a421-33d0b919e527 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:36.567285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-490c177e-5714-4be2-a421-33d0b919e527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:36.575481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1230/2432] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:36.594509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647796de-7149-427e-b6d9-ea52e30944bd service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:36.605525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647796de-7149-427e-b6d9-ea52e30944bd service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:36.611030 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:36.611579 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:36.611861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:36.612134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:36.620068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:36.621669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:36.631334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1203/2433] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:52:39.690718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00948792-83ba-4b9b-86f4-6054488fb739 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:39.691209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00948792-83ba-4b9b-86f4-6054488fb739 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:39.691335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00948792-83ba-4b9b-86f4-6054488fb739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:39.712365 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-00948792-83ba-4b9b-86f4-6054488fb739 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:39.713580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-00948792-83ba-4b9b-86f4-6054488fb739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:39.721412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1231/2434] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:39.737112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:39.738491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:39.753256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7558679-de31-4f8f-8f1e-3ae466b11bc9 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:39.759273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836f55b-b4e5-4bbb-a71f-89992b2d8b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:39.759885 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836f55b-b4e5-4bbb-a71f-89992b2d8b63 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:39.760147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836f55b-b4e5-4bbb-a71f-89992b2d8b63 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:39.760419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836f55b-b4e5-4bbb-a71f-89992b2d8b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:39.768308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836f55b-b4e5-4bbb-a71f-89992b2d8b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:39.770193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836f55b-b4e5-4bbb-a71f-89992b2d8b63 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:39.779480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1204/2435] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:52:43.889950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef34bc3-b80f-4cca-9cac-219db786315b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:43.890451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef34bc3-b80f-4cca-9cac-219db786315b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:43.890565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef34bc3-b80f-4cca-9cac-219db786315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:43.910957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-5ef34bc3-b80f-4cca-9cac-219db786315b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:43.912147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5ef34bc3-b80f-4cca-9cac-219db786315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:43.919899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1232/2436] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Oct 4 12:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:43.933966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836f55b-b4e5-4bbb-a71f-89992b2d8b63 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:52:43.946563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836f55b-b4e5-4bbb-a71f-89992b2d8b63 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:52:43.952315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc3cb3-dde4-4a3a-8417-48803f477bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:52:43.952921 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3cb3-dde4-4a3a-8417-48803f477bed service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:43.953199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3cb3-dde4-4a3a-8417-48803f477bed service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:43.953471 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3cb3-dde4-4a3a-8417-48803f477bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:43.962133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc3cb3-dde4-4a3a-8417-48803f477bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:52:43.963702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc3cb3-dde4-4a3a-8417-48803f477bed service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:52:43.972903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1205/2437] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:52:44.751277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6079-a5fe-4975-8372-4970e5a18925 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:44.751565 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6079-a5fe-4975-8372-4970e5a18925 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:44.751841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb6079-a5fe-4975-8372-4970e5a18925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:44.772000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-acbb6079-a5fe-4975-8372-4970e5a18925 None None] MFA Rules not processed for user `c1309821469549fe82a2c419ef4434d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:44.773180 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-acbb6079-a5fe-4975-8372-4970e5a18925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:44.825829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1233/2438] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:53.354728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c929f-53f6-4e10-9a1b-f07f7a15ceae None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:52:53.355227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c929f-53f6-4e10-9a1b-f07f7a15ceae None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:52:53.355324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c929f-53f6-4e10-9a1b-f07f7a15ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:52:53.373571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e35c929f-53f6-4e10-9a1b-f07f7a15ceae None None] MFA Rules not processed for user `9c932f6c9f8b4e5d8eedfb5b597c0007`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:52:53.374779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e35c929f-53f6-4e10-9a1b-f07f7a15ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:52:53.428468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1206/2439] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:52:54.819380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=64 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:03.421735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=83 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:14.362415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb6079-a5fe-4975-8372-4970e5a18925 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:14.364621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-acbb6079-a5fe-4975-8372-4970e5a18925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:14.386594 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb6079-a5fe-4975-8372-4970e5a18925 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:14.391673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:14.392540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:14.393024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:14.393444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] PATH_INFO: `/v3/users/28d46c9f9371467fa4c37bf282f6aebb` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:14.395628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d46c9f9371467fa4c37bf282f6aebb)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:14.398328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:14.464358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d46c9f9371467fa4c37bf282f6aebb'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.465193 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d46c9f9371467fa4c37bf282f6aebb'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.473770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d46c9f9371467fa4c37bf282f6aebb'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.474503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d46c9f9371467fa4c37bf282f6aebb'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.489897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1f582886-0b33-4832-98ce-dc8dc463a722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d46c9f9371467fa4c37bf282f6aebb'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.507516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1234/2440] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:53:14 2022] DELETE /identity/v3/users/28d46c9f9371467fa4c37bf282f6aebb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:14.723560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c929f-53f6-4e10-9a1b-f07f7a15ceae None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:14.758444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c929f-53f6-4e10-9a1b-f07f7a15ceae None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:14.832270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:14.832925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:14.833299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:14.833674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] PATH_INFO: `/v3/projects/a070259364724d7ab23373310b569d6e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:14.836582 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a070259364724d7ab23373310b569d6e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:14.839294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:14.899479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a070259364724d7ab23373310b569d6e', 'request_id': 'req-e44657b6-7924-4a40-9ec8-20afce5cb902'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.905864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a070259364724d7ab23373310b569d6e', 'request_id': 'req-e44657b6-7924-4a40-9ec8-20afce5cb902'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.914719 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a070259364724d7ab23373310b569d6e', 'request_id': 'req-e44657b6-7924-4a40-9ec8-20afce5cb902'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.930273 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] The token cache is being invalidate because project a070259364724d7ab23373310b569d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:53:14.930571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.931315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:14.932864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1207/2441] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:53:14 2022] DELETE /identity/v3/projects/a070259364724d7ab23373310b569d6e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:16.433413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec341-8761-411b-9d86-164de8e41875 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:16.433945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec341-8761-411b-9d86-164de8e41875 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:16.434050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ec341-8761-411b-9d86-164de8e41875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:16.453388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-535ec341-8761-411b-9d86-164de8e41875 None None] MFA Rules not processed for user `66f98af5c7194ce58dde8258e2ecf945`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:16.454628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-535ec341-8761-411b-9d86-164de8e41875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:16.508349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1235/2442] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:24.925886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:26.501238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:45.641380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:45.642910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:45.708847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44657b6-7924-4a40-9ec8-20afce5cb902 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:45.713420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:45.714078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:45.714364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:45.714643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] PATH_INFO: `/v3/users/c1309821469549fe82a2c419ef4434d2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:45.715858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1309821469549fe82a2c419ef4434d2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:45.718041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:45.790255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1309821469549fe82a2c419ef4434d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:45.791042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1309821469549fe82a2c419ef4434d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:45.799753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1309821469549fe82a2c419ef4434d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:45.800527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1309821469549fe82a2c419ef4434d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:45.809414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-652cd70c-8e92-4d88-8b40-d2ac8aacedda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1309821469549fe82a2c419ef4434d2'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:45.830844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1208/2443] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:53:45 2022] DELETE /identity/v3/users/c1309821469549fe82a2c419ef4434d2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:46.002697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ec341-8761-411b-9d86-164de8e41875 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.018297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ec341-8761-411b-9d86-164de8e41875 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.076322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.076957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.077242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.077553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] PATH_INFO: `/v3/projects/fbb4053e833f456e9d302ab5f761fcba` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.078708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb4053e833f456e9d302ab5f761fcba)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.080629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.127181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb4053e833f456e9d302ab5f761fcba', 'request_id': 'req-f79b87c6-d885-413c-ab9c-77bb815732a4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:46.133292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb4053e833f456e9d302ab5f761fcba', 'request_id': 'req-f79b87c6-d885-413c-ab9c-77bb815732a4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:46.139316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb4053e833f456e9d302ab5f761fcba', 'request_id': 'req-f79b87c6-d885-413c-ab9c-77bb815732a4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:46.152808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] The token cache is being invalidate because project fbb4053e833f456e9d302ab5f761fcba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:53:46.153099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:46.153900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f79b87c6-d885-413c-ab9c-77bb815732a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:46.155587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1236/2444] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:53:46 2022] DELETE /identity/v3/projects/fbb4053e833f456e9d302ab5f761fcba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:46.160455 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde1d8-4cc1-43c3-af7e-e3b0eacfee25 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.160740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde1d8-4cc1-43c3-af7e-e3b0eacfee25 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.161011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde1d8-4cc1-43c3-af7e-e3b0eacfee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.180028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-e1bde1d8-4cc1-43c3-af7e-e3b0eacfee25 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:46.181232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e1bde1d8-4cc1-43c3-af7e-e3b0eacfee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:46.239652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1209/2445] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:46.248154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a131-29d8-4179-98b6-57fc1c7cf9f3 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.248369 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a131-29d8-4179-98b6-57fc1c7cf9f3 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.248651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2a131-29d8-4179-98b6-57fc1c7cf9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.267777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6ca2a131-29d8-4179-98b6-57fc1c7cf9f3 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:46.269242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6ca2a131-29d8-4179-98b6-57fc1c7cf9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:46.277424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1237/2446] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:46.281571 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde1d8-4cc1-43c3-af7e-e3b0eacfee25 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.291485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde1d8-4cc1-43c3-af7e-e3b0eacfee25 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.295985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.296580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.296860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.297133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.297796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:53:46.298100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.299702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.311573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1210/2447] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:53:46.315767 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a131-29d8-4179-98b6-57fc1c7cf9f3 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.325058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2a131-29d8-4179-98b6-57fc1c7cf9f3 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.329728 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8907d2-5024-45fb-a858-d6e23a609cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.330332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8907d2-5024-45fb-a858-d6e23a609cfc admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.330616 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8907d2-5024-45fb-a858-d6e23a609cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.330888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8907d2-5024-45fb-a858-d6e23a609cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.331525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8907d2-5024-45fb-a858-d6e23a609cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.333429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8907d2-5024-45fb-a858-d6e23a609cfc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.361098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1238/2448] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:53:46 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:46.365201 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.375610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db126a-1bd6-4baf-9b10-7d622c34342c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.379085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:46.552500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8ace2-9be9-4fb1-9d41-4790e244c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.553014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8ace2-9be9-4fb1-9d41-4790e244c7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.553295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8ace2-9be9-4fb1-9d41-4790e244c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.553567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8ace2-9be9-4fb1-9d41-4790e244c7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.554239 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8ace2-9be9-4fb1-9d41-4790e244c7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.556163 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8ace2-9be9-4fb1-9d41-4790e244c7b1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.576536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1211/2449] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:53:46 2022] POST /identity/v3/users => generated 303 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:46.580742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8907d2-5024-45fb-a858-d6e23a609cfc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.591393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8907d2-5024-45fb-a858-d6e23a609cfc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.595920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc2f83-99d8-4a41-881f-3e173ad0c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.596519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc2f83-99d8-4a41-881f-3e173ad0c7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.596800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc2f83-99d8-4a41-881f-3e173ad0c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.597076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc2f83-99d8-4a41-881f-3e173ad0c7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.597750 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc2f83-99d8-4a41-881f-3e173ad0c7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.599345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc2f83-99d8-4a41-881f-3e173ad0c7c3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.609673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1239/2450] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:46.613340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8ace2-9be9-4fb1-9d41-4790e244c7b1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.622893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8ace2-9be9-4fb1-9d41-4790e244c7b1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.627459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1745-3168-49b2-bad5-c7d6a6f91585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.628047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1745-3168-49b2-bad5-c7d6a6f91585 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.628326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1745-3168-49b2-bad5-c7d6a6f91585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.628598 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1745-3168-49b2-bad5-c7d6a6f91585 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.629227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1745-3168-49b2-bad5-c7d6a6f91585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.630842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1745-3168-49b2-bad5-c7d6a6f91585 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.640420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1212/2451] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:46.644745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc2f83-99d8-4a41-881f-3e173ad0c7c3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.654886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc2f83-99d8-4a41-881f-3e173ad0c7c3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.659432 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36b92b-a0f1-429e-9603-bdf808b2324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.660070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36b92b-a0f1-429e-9603-bdf808b2324f admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.660351 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36b92b-a0f1-429e-9603-bdf808b2324f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.660624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36b92b-a0f1-429e-9603-bdf808b2324f admin admin] PATH_INFO: `/v3/projects/01283e5616d048718be7cc9ed6b2779c/users/520f4c2540444cad8b2104bcd7e12e82/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.675802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36b92b-a0f1-429e-9603-bdf808b2324f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01283e5616d048718be7cc9ed6b2779c, user_id=520f4c2540444cad8b2104bcd7e12e82, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.678672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36b92b-a0f1-429e-9603-bdf808b2324f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.690740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1240/2452] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:46 2022] PUT /identity/v3/projects/01283e5616d048718be7cc9ed6b2779c/users/520f4c2540444cad8b2104bcd7e12e82/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:46.700728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8615aa-61d9-4404-8be3-f69cc855294e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.701206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8615aa-61d9-4404-8be3-f69cc855294e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.701311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8615aa-61d9-4404-8be3-f69cc855294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.728824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fd8615aa-61d9-4404-8be3-f69cc855294e None None] MFA Rules not processed for user `520f4c2540444cad8b2104bcd7e12e82`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:46.730040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fd8615aa-61d9-4404-8be3-f69cc855294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:46.792100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1213/2453] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:46.796543 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36b92b-a0f1-429e-9603-bdf808b2324f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.827215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:46.861089 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36b92b-a0f1-429e-9603-bdf808b2324f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.865707 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb481c3e-55ef-47da-91a9-b6b1d8f7a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.866340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481c3e-55ef-47da-91a9-b6b1d8f7a208 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.866623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481c3e-55ef-47da-91a9-b6b1d8f7a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.866893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481c3e-55ef-47da-91a9-b6b1d8f7a208 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.867572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb481c3e-55ef-47da-91a9-b6b1d8f7a208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.869513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb481c3e-55ef-47da-91a9-b6b1d8f7a208 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.896684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1241/2454] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:53:46 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:46.901359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8615aa-61d9-4404-8be3-f69cc855294e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:46.911694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8615aa-61d9-4404-8be3-f69cc855294e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:46.966964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a6e6-c6d0-480b-b9bc-2209ff05bb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:46.967734 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a6e6-c6d0-480b-b9bc-2209ff05bb15 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:46.968019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a6e6-c6d0-480b-b9bc-2209ff05bb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:46.968318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a6e6-c6d0-480b-b9bc-2209ff05bb15 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:46.968942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a6e6-c6d0-480b-b9bc-2209ff05bb15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:46.970945 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a6e6-c6d0-480b-b9bc-2209ff05bb15 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:46.991943 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1214/2455] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:53:46 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:46.996144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb481c3e-55ef-47da-91a9-b6b1d8f7a208 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:47.006879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb481c3e-55ef-47da-91a9-b6b1d8f7a208 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:47.011567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c865-af1f-431b-8479-f312daf1b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:47.012303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c865-af1f-431b-8479-f312daf1b18c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.012589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c865-af1f-431b-8479-f312daf1b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.012860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c865-af1f-431b-8479-f312daf1b18c admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.013501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0c865-af1f-431b-8479-f312daf1b18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:47.015118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0c865-af1f-431b-8479-f312daf1b18c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:47.027139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1242/2456] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:53:47.031419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a6e6-c6d0-480b-b9bc-2209ff05bb15 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:47.037816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:47.042683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a6e6-c6d0-480b-b9bc-2209ff05bb15 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:47.049662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0391-5d90-422a-b0cc-c243c255560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:47.050853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0391-5d90-422a-b0cc-c243c255560b admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.050853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0391-5d90-422a-b0cc-c243c255560b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.051036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0391-5d90-422a-b0cc-c243c255560b admin admin] PATH_INFO: `/v3/projects/758246f2b4ed4c24b0b6c123a459fb3e/users/e5d4bf636fc24a4da9f8bc638adf1418/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.068081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea0391-5d90-422a-b0cc-c243c255560b admin admin] RBAC: Authorizing `identity:create_grant(project_id=758246f2b4ed4c24b0b6c123a459fb3e, user_id=e5d4bf636fc24a4da9f8bc638adf1418, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:47.071283 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea0391-5d90-422a-b0cc-c243c255560b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:47.085264 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1215/2457] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:47 2022] PUT /identity/v3/projects/758246f2b4ed4c24b0b6c123a459fb3e/users/e5d4bf636fc24a4da9f8bc638adf1418/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:47.088972 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c865-af1f-431b-8479-f312daf1b18c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:47.098762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c865-af1f-431b-8479-f312daf1b18c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:47.156971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c2db4-0c72-4ea8-b60e-ffe33d4beb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:47.157572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2db4-0c72-4ea8-b60e-ffe33d4beb6f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.157878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2db4-0c72-4ea8-b60e-ffe33d4beb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.158149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c2db4-0c72-4ea8-b60e-ffe33d4beb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.158976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c2db4-0c72-4ea8-b60e-ffe33d4beb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:47.160392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c2db4-0c72-4ea8-b60e-ffe33d4beb6f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:47.171226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1243/2458] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:53:47.175309 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0391-5d90-422a-b0cc-c243c255560b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:47.185832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0391-5d90-422a-b0cc-c243c255560b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:47.190295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:47.190957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.191236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.191510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] PATH_INFO: `/v3/projects/758246f2b4ed4c24b0b6c123a459fb3e/users/e5d4bf636fc24a4da9f8bc638adf1418/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.193381 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758246f2b4ed4c24b0b6c123a459fb3e, user_id=e5d4bf636fc24a4da9f8bc638adf1418, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:47.196056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:47.205843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1216/2459] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:47 2022] PUT /identity/v3/projects/758246f2b4ed4c24b0b6c123a459fb3e/users/e5d4bf636fc24a4da9f8bc638adf1418/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:53:47.217619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61d6b-20f9-4a07-a820-a03904c3b88f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.217931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61d6b-20f9-4a07-a820-a03904c3b88f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.218209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61d6b-20f9-4a07-a820-a03904c3b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.245961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ead61d6b-20f9-4a07-a820-a03904c3b88f None None] MFA Rules not processed for user `e5d4bf636fc24a4da9f8bc638adf1418`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:47.247154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ead61d6b-20f9-4a07-a820-a03904c3b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:47.313733 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1244/2460] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:47.324364 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:47.326081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:47.383387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e7145-6bb9-4e6b-a73c-d36c918f0cb7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:47.386958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a36b5-fb7e-49aa-af49-65b4e418d790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:47.387549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a36b5-fb7e-49aa-af49-65b4e418d790 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.387827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a36b5-fb7e-49aa-af49-65b4e418d790 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.388096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a36b5-fb7e-49aa-af49-65b4e418d790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.397439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a36b5-fb7e-49aa-af49-65b4e418d790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:47.398893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a36b5-fb7e-49aa-af49-65b4e418d790 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:47.407946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1217/2461] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:53:47.542753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead61d6b-20f9-4a07-a820-a03904c3b88f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:47.567732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:47.605292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead61d6b-20f9-4a07-a820-a03904c3b88f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:47.609832 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:47.610460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.610744 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.611019 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] PATH_INFO: `/v3/users/520f4c2540444cad8b2104bcd7e12e82` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.612138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520f4c2540444cad8b2104bcd7e12e82)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:47.614101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:47.658994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520f4c2540444cad8b2104bcd7e12e82'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:47.659575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520f4c2540444cad8b2104bcd7e12e82'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:47.666790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520f4c2540444cad8b2104bcd7e12e82'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:47.667419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520f4c2540444cad8b2104bcd7e12e82'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:47.679428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520f4c2540444cad8b2104bcd7e12e82'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:47.691787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1245/2462] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:53:47 2022] DELETE /identity/v3/users/520f4c2540444cad8b2104bcd7e12e82 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:47.696418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c5f1-9652-46bb-a482-a9d45bf2b277 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.696709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c5f1-9652-46bb-a482-a9d45bf2b277 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.697003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c5f1-9652-46bb-a482-a9d45bf2b277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.715209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6130c5f1-9652-46bb-a482-a9d45bf2b277 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:47.716401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6130c5f1-9652-46bb-a482-a9d45bf2b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:47.774431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1218/2463] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:47.784047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:47.785433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:47.841996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4362f7-81d1-4764-8598-e129f915d667 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:47.845591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43d786-6d95-49d6-9c10-5fcfcc6aff40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:47.846220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43d786-6d95-49d6-9c10-5fcfcc6aff40 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:47.846504 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43d786-6d95-49d6-9c10-5fcfcc6aff40 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:47.846779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43d786-6d95-49d6-9c10-5fcfcc6aff40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:47.855797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43d786-6d95-49d6-9c10-5fcfcc6aff40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:47.857235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43d786-6d95-49d6-9c10-5fcfcc6aff40 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:47.866806 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1246/2464] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:53:48.131967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130c5f1-9652-46bb-a482-a9d45bf2b277 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:48.133833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6130c5f1-9652-46bb-a482-a9d45bf2b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:48.146260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130c5f1-9652-46bb-a482-a9d45bf2b277 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:48.151053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:48.151689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:48.151977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:48.152250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] PATH_INFO: `/v3/projects/01283e5616d048718be7cc9ed6b2779c` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:48.153369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01283e5616d048718be7cc9ed6b2779c)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:48.157045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:48.210807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01283e5616d048718be7cc9ed6b2779c', 'request_id': 'req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.216692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01283e5616d048718be7cc9ed6b2779c', 'request_id': 'req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.225332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01283e5616d048718be7cc9ed6b2779c', 'request_id': 'req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.227991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:48.241358 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] The token cache is being invalidate because project 01283e5616d048718be7cc9ed6b2779c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:53:48.241694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.242340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.244010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1219/2465] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:53:48 2022] DELETE /identity/v3/projects/01283e5616d048718be7cc9ed6b2779c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:48.247999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43d786-6d95-49d6-9c10-5fcfcc6aff40 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:48.258077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43d786-6d95-49d6-9c10-5fcfcc6aff40 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:48.301183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:48.317443 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:48.319087 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:48.319372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:48.319650 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] PATH_INFO: `/v3/users/e5d4bf636fc24a4da9f8bc638adf1418` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:48.320813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d4bf636fc24a4da9f8bc638adf1418)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:48.322776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:48.369124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d4bf636fc24a4da9f8bc638adf1418'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.369811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d4bf636fc24a4da9f8bc638adf1418'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.376774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d4bf636fc24a4da9f8bc638adf1418'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.377557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d4bf636fc24a4da9f8bc638adf1418'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.391457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0750d7f3-038f-4cae-8e34-5c74083a1957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d4bf636fc24a4da9f8bc638adf1418'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.404912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1247/2466] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:53:48 2022] DELETE /identity/v3/users/e5d4bf636fc24a4da9f8bc638adf1418 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:48.669622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:48.671145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:48.686909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3e21-f061-4b08-8c7e-6ff7b8ca6d18 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:48.744517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:48.745125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:48.745405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:48.745709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] PATH_INFO: `/v3/projects/758246f2b4ed4c24b0b6c123a459fb3e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:48.746811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758246f2b4ed4c24b0b6c123a459fb3e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:48.749517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:48.793548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758246f2b4ed4c24b0b6c123a459fb3e', 'request_id': 'req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.798890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758246f2b4ed4c24b0b6c123a459fb3e', 'request_id': 'req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.808810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758246f2b4ed4c24b0b6c123a459fb3e', 'request_id': 'req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.820321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] The token cache is being invalidate because project 758246f2b4ed4c24b0b6c123a459fb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:53:48.820616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.821245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-4f3e9969-cbbb-4bb3-a9df-285bfff085b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:48.822725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1220/2467] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:53:48 2022] DELETE /identity/v3/projects/758246f2b4ed4c24b0b6c123a459fb3e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:48.827567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9018b-aa31-494f-af55-1eb99748b620 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:48.827861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9018b-aa31-494f-af55-1eb99748b620 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:48.828143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9018b-aa31-494f-af55-1eb99748b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:48.847538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ebf9018b-aa31-494f-af55-1eb99748b620 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:48.848740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ebf9018b-aa31-494f-af55-1eb99748b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:48.906266 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1248/2468] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:48.913948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c78d-d822-4f99-aeaf-8db7fb16e3e2 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:48.914232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c78d-d822-4f99-aeaf-8db7fb16e3e2 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:48.914504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c78d-d822-4f99-aeaf-8db7fb16e3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:48.933896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7f93c78d-d822-4f99-aeaf-8db7fb16e3e2 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:48.935073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7f93c78d-d822-4f99-aeaf-8db7fb16e3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:48.942638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1221/2469] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:48.947272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9018b-aa31-494f-af55-1eb99748b620 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:48.956944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9018b-aa31-494f-af55-1eb99748b620 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:48.962196 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:48.962791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:48.963072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:48.963346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:48.963985 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:53:48.964287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:48.965931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:48.977867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1249/2470] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:53:48.982016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93c78d-d822-4f99-aeaf-8db7fb16e3e2 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:48.990858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93c78d-d822-4f99-aeaf-8db7fb16e3e2 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:48.995356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b54f05-ba7f-4eb7-9992-99ad3c55bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:48.995937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54f05-ba7f-4eb7-9992-99ad3c55bdcb admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:48.996217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54f05-ba7f-4eb7-9992-99ad3c55bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:48.996485 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54f05-ba7f-4eb7-9992-99ad3c55bdcb admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:48.997100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b54f05-ba7f-4eb7-9992-99ad3c55bdcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:48.999025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b54f05-ba7f-4eb7-9992-99ad3c55bdcb admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.026298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1222/2471] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:53:48 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:49.030057 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.040410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452a76b-1018-4789-b1a1-8264359380e6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.087860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:49.099462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acd340-9c5c-4d62-ad8c-0c3df8d51bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.100526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd340-9c5c-4d62-ad8c-0c3df8d51bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.101008 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd340-9c5c-4d62-ad8c-0c3df8d51bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.101229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd340-9c5c-4d62-ad8c-0c3df8d51bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.102246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acd340-9c5c-4d62-ad8c-0c3df8d51bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.104808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acd340-9c5c-4d62-ad8c-0c3df8d51bc2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.125579 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1250/2472] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:53:49 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:49.129710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b54f05-ba7f-4eb7-9992-99ad3c55bdcb admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.140218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b54f05-ba7f-4eb7-9992-99ad3c55bdcb admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.147930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d4be-9895-4ba3-aba0-77aa91067389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.148869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d4be-9895-4ba3-aba0-77aa91067389 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.149303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d4be-9895-4ba3-aba0-77aa91067389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.149824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0d4be-9895-4ba3-aba0-77aa91067389 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.150893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0d4be-9895-4ba3-aba0-77aa91067389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.153849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0d4be-9895-4ba3-aba0-77aa91067389 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.164235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1223/2473] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:49.168342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acd340-9c5c-4d62-ad8c-0c3df8d51bc2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.178042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acd340-9c5c-4d62-ad8c-0c3df8d51bc2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.182539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1851c-b4e9-4091-bd98-c90095a794e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.183124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1851c-b4e9-4091-bd98-c90095a794e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.183402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1851c-b4e9-4091-bd98-c90095a794e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.183669 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1851c-b4e9-4091-bd98-c90095a794e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.184295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1851c-b4e9-4091-bd98-c90095a794e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.185925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1851c-b4e9-4091-bd98-c90095a794e6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.196692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1251/2474] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:49.200671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d4be-9895-4ba3-aba0-77aa91067389 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.211334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0d4be-9895-4ba3-aba0-77aa91067389 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.215907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf48a7b-5503-427a-a15c-9604e1b3b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.216535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48a7b-5503-427a-a15c-9604e1b3b063 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.216816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48a7b-5503-427a-a15c-9604e1b3b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.217097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf48a7b-5503-427a-a15c-9604e1b3b063 admin admin] PATH_INFO: `/v3/projects/b381e772db1b44d983ea1def07800329/users/505e8faaf2124e85846399971b923263/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.231129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf48a7b-5503-427a-a15c-9604e1b3b063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b381e772db1b44d983ea1def07800329, user_id=505e8faaf2124e85846399971b923263, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.233799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf48a7b-5503-427a-a15c-9604e1b3b063 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.246474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1224/2475] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:49 2022] PUT /identity/v3/projects/b381e772db1b44d983ea1def07800329/users/505e8faaf2124e85846399971b923263/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:49.257291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ea5fc-9625-443b-954f-610cb98033ba None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.257810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ea5fc-9625-443b-954f-610cb98033ba None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.257908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ea5fc-9625-443b-954f-610cb98033ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.285435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-be0ea5fc-9625-443b-954f-610cb98033ba None None] MFA Rules not processed for user `505e8faaf2124e85846399971b923263`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:49.286605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-be0ea5fc-9625-443b-954f-610cb98033ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:49.349613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1252/2476] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:53:49.354181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf48a7b-5503-427a-a15c-9604e1b3b063 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.377807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:49.423675 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf48a7b-5503-427a-a15c-9604e1b3b063 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.429183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d812-cfb9-40f2-9bc1-4e390a0f9e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.429861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d812-cfb9-40f2-9bc1-4e390a0f9e70 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.430143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d812-cfb9-40f2-9bc1-4e390a0f9e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.430416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d812-cfb9-40f2-9bc1-4e390a0f9e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.431103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d812-cfb9-40f2-9bc1-4e390a0f9e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.433053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d812-cfb9-40f2-9bc1-4e390a0f9e70 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.461919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1225/2477] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:53:49 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:49.466020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ea5fc-9625-443b-954f-610cb98033ba None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.478582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ea5fc-9625-443b-954f-610cb98033ba None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.534644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0dec9-19af-490f-a3d8-8f758eba078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.535256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0dec9-19af-490f-a3d8-8f758eba078c admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.535591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0dec9-19af-490f-a3d8-8f758eba078c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.535813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0dec9-19af-490f-a3d8-8f758eba078c admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.536442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0dec9-19af-490f-a3d8-8f758eba078c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.538952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0dec9-19af-490f-a3d8-8f758eba078c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.559408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1253/2478] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:53:49 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:53:49.563580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d812-cfb9-40f2-9bc1-4e390a0f9e70 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.573817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d812-cfb9-40f2-9bc1-4e390a0f9e70 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.578409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39daf4-38a8-4079-bffd-ba79db10e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.579003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39daf4-38a8-4079-bffd-ba79db10e795 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.579282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39daf4-38a8-4079-bffd-ba79db10e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.579554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39daf4-38a8-4079-bffd-ba79db10e795 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.580187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39daf4-38a8-4079-bffd-ba79db10e795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.581821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39daf4-38a8-4079-bffd-ba79db10e795 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.592638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1226/2479] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:49.596759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0dec9-19af-490f-a3d8-8f758eba078c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.606982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0dec9-19af-490f-a3d8-8f758eba078c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.611470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5696-4462-4572-9c06-520cc219b72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.612108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5696-4462-4572-9c06-520cc219b72a admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.612385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5696-4462-4572-9c06-520cc219b72a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.612656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5696-4462-4572-9c06-520cc219b72a admin admin] PATH_INFO: `/v3/projects/a45bc7dd5b484cf8a5e4426cb8c0d3a6/users/83870014c9e048028a1c0bf59d2d2f6b/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.627233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b5696-4462-4572-9c06-520cc219b72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45bc7dd5b484cf8a5e4426cb8c0d3a6, user_id=83870014c9e048028a1c0bf59d2d2f6b, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.629901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b5696-4462-4572-9c06-520cc219b72a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.642983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1254/2480] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:49 2022] PUT /identity/v3/projects/a45bc7dd5b484cf8a5e4426cb8c0d3a6/users/83870014c9e048028a1c0bf59d2d2f6b/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:53:49.647099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39daf4-38a8-4079-bffd-ba79db10e795 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.656880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39daf4-38a8-4079-bffd-ba79db10e795 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.717120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eefee3-1161-40ae-9c0e-ba64aa6d9fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.717765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefee3-1161-40ae-9c0e-ba64aa6d9fee admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.718047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefee3-1161-40ae-9c0e-ba64aa6d9fee admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.718321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefee3-1161-40ae-9c0e-ba64aa6d9fee admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.718950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eefee3-1161-40ae-9c0e-ba64aa6d9fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.720537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eefee3-1161-40ae-9c0e-ba64aa6d9fee admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.729968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1227/2481] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:49.734307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5696-4462-4572-9c06-520cc219b72a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.744913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5696-4462-4572-9c06-520cc219b72a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.749783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.750435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.750715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.750990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] PATH_INFO: `/v3/projects/a45bc7dd5b484cf8a5e4426cb8c0d3a6/users/83870014c9e048028a1c0bf59d2d2f6b/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.752883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45bc7dd5b484cf8a5e4426cb8c0d3a6, user_id=83870014c9e048028a1c0bf59d2d2f6b, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:49.755548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:49.766012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1255/2482] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:49 2022] PUT /identity/v3/projects/a45bc7dd5b484cf8a5e4426cb8c0d3a6/users/83870014c9e048028a1c0bf59d2d2f6b/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:49.777511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dee68-ca6e-46a0-867f-65c715a90fd4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.778049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dee68-ca6e-46a0-867f-65c715a90fd4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.778157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dee68-ca6e-46a0-867f-65c715a90fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:49.805991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d32dee68-ca6e-46a0-867f-65c715a90fd4 None None] MFA Rules not processed for user `83870014c9e048028a1c0bf59d2d2f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:49.807115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d32dee68-ca6e-46a0-867f-65c715a90fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:49.872359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1228/2483] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:49.883618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:49.885307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:49.899843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:49.944671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bc5a9-423f-4f6b-9ca5-b83ac41d80f8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:49.948288 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a272-480c-4be5-bed9-56fb4e29133c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:49.948889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a272-480c-4be5-bed9-56fb4e29133c service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:49.949169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a272-480c-4be5-bed9-56fb4e29133c service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:49.949441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a272-480c-4be5-bed9-56fb4e29133c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:50.003293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9a272-480c-4be5-bed9-56fb4e29133c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:50.004717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9a272-480c-4be5-bed9-56fb4e29133c service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:50.013710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1256/2484] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:53:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:53:51.367950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dee68-ca6e-46a0-867f-65c715a90fd4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:51.369345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d32dee68-ca6e-46a0-867f-65c715a90fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:51.381280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dee68-ca6e-46a0-867f-65c715a90fd4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:51.384870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b32d2-0edf-43bb-84d3-55a4ec491a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:51.385473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b32d2-0edf-43bb-84d3-55a4ec491a43 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:51.385791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b32d2-0edf-43bb-84d3-55a4ec491a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:51.386064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b32d2-0edf-43bb-84d3-55a4ec491a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:51.394981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b32d2-0edf-43bb-84d3-55a4ec491a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:51.396413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b32d2-0edf-43bb-84d3-55a4ec491a43 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:51.405812 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1229/2485] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:53:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:53:55.179222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a272-480c-4be5-bed9-56fb4e29133c service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:55.240075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a272-480c-4be5-bed9-56fb4e29133c service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:55.245287 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:55.245961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:55.246242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:55.246515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] PATH_INFO: `/v3/users/505e8faaf2124e85846399971b923263` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:55.247639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505e8faaf2124e85846399971b923263)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:55.249549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:55.298420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505e8faaf2124e85846399971b923263'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.299125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505e8faaf2124e85846399971b923263'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.306800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505e8faaf2124e85846399971b923263'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.307453 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505e8faaf2124e85846399971b923263'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.315689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:55.321759 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505e8faaf2124e85846399971b923263'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.337366 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1257/2486] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:53:55 2022] DELETE /identity/v3/users/505e8faaf2124e85846399971b923263 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:55.341757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395449db-adef-41f2-89b8-6e34fc56ed13 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:55.342223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395449db-adef-41f2-89b8-6e34fc56ed13 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:55.342332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395449db-adef-41f2-89b8-6e34fc56ed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:55.349237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:55.362434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-395449db-adef-41f2-89b8-6e34fc56ed13 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:55.363680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-395449db-adef-41f2-89b8-6e34fc56ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:55.425418 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1230/2487] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:55.435843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:55.437247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:55.494080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55226d8e-cf79-4056-950f-6465ed4bff83 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:55.497778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5e92-32c7-4aa1-84bb-51af1e6538d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:55.498384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5e92-32c7-4aa1-84bb-51af1e6538d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:55.498673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5e92-32c7-4aa1-84bb-51af1e6538d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:55.498952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b5e92-32c7-4aa1-84bb-51af1e6538d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:55.507789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b5e92-32c7-4aa1-84bb-51af1e6538d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:55.509212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b5e92-32c7-4aa1-84bb-51af1e6538d5 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:55.518710 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1258/2488] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:53:55.787897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395449db-adef-41f2-89b8-6e34fc56ed13 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:55.789424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-395449db-adef-41f2-89b8-6e34fc56ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:55.801459 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395449db-adef-41f2-89b8-6e34fc56ed13 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:55.806129 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:55.806796 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:55.807078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:55.807356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] PATH_INFO: `/v3/projects/b381e772db1b44d983ea1def07800329` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:55.808475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b381e772db1b44d983ea1def07800329)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:55.810439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:55.857210 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b381e772db1b44d983ea1def07800329', 'request_id': 'req-282c2710-a9ff-4f2c-b251-e1421e042d04'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.862656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b381e772db1b44d983ea1def07800329', 'request_id': 'req-282c2710-a9ff-4f2c-b251-e1421e042d04'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.869652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b381e772db1b44d983ea1def07800329', 'request_id': 'req-282c2710-a9ff-4f2c-b251-e1421e042d04'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.880193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] The token cache is being invalidate because project b381e772db1b44d983ea1def07800329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:53:55.880477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.881619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:55.883083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1231/2489] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:53:55 2022] DELETE /identity/v3/projects/b381e772db1b44d983ea1def07800329 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:55.887019 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5e92-32c7-4aa1-84bb-51af1e6538d5 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:55.896512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b5e92-32c7-4aa1-84bb-51af1e6538d5 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:55.951200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:55.951740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:55.952021 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:55.952292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] PATH_INFO: `/v3/users/83870014c9e048028a1c0bf59d2d2f6b` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:55.953380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83870014c9e048028a1c0bf59d2d2f6b)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:55.955327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:56.003090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83870014c9e048028a1c0bf59d2d2f6b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.003742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83870014c9e048028a1c0bf59d2d2f6b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.011025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83870014c9e048028a1c0bf59d2d2f6b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.011661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83870014c9e048028a1c0bf59d2d2f6b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.024026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-252c920e-4663-4ef3-9be2-7aebbb099b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83870014c9e048028a1c0bf59d2d2f6b'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.036961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1259/2490] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:53:55 2022] DELETE /identity/v3/users/83870014c9e048028a1c0bf59d2d2f6b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:56.319373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:56.320844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:56.335133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c2710-a9ff-4f2c-b251-e1421e042d04 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:56.392653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:56.393585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.393825 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.394096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] PATH_INFO: `/v3/projects/a45bc7dd5b484cf8a5e4426cb8c0d3a6` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.395195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45bc7dd5b484cf8a5e4426cb8c0d3a6)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:56.397210 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:56.433728 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:56.452865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45bc7dd5b484cf8a5e4426cb8c0d3a6', 'request_id': 'req-d8fce2fc-6a57-4605-9c16-68102229569f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.461427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45bc7dd5b484cf8a5e4426cb8c0d3a6', 'request_id': 'req-d8fce2fc-6a57-4605-9c16-68102229569f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.469545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45bc7dd5b484cf8a5e4426cb8c0d3a6', 'request_id': 'req-d8fce2fc-6a57-4605-9c16-68102229569f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.481991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] The token cache is being invalidate because project a45bc7dd5b484cf8a5e4426cb8c0d3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:53:56.482286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.482950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d8fce2fc-6a57-4605-9c16-68102229569f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:56.484430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1232/2491] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:53:56 2022] DELETE /identity/v3/projects/a45bc7dd5b484cf8a5e4426cb8c0d3a6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:56.489437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771512b9-0f8f-4cac-ae7e-dace366cbf12 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.489978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771512b9-0f8f-4cac-ae7e-dace366cbf12 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.490097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771512b9-0f8f-4cac-ae7e-dace366cbf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.503642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:56.510373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-771512b9-0f8f-4cac-ae7e-dace366cbf12 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:56.512187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-771512b9-0f8f-4cac-ae7e-dace366cbf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:56.572872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1260/2492] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:56.580537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510b1dd-f20d-4c5f-901a-f8bc56f39a92 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.580898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510b1dd-f20d-4c5f-901a-f8bc56f39a92 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.581243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510b1dd-f20d-4c5f-901a-f8bc56f39a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.601340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8510b1dd-f20d-4c5f-901a-f8bc56f39a92 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:56.602659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8510b1dd-f20d-4c5f-901a-f8bc56f39a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:56.610457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1233/2493] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:56.614568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771512b9-0f8f-4cac-ae7e-dace366cbf12 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:56.624509 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771512b9-0f8f-4cac-ae7e-dace366cbf12 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:56.629119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:56.629745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.630028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.630299 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.630936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:53:56.631753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:56.633329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:56.645431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1261/2494] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:53:56.650097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510b1dd-f20d-4c5f-901a-f8bc56f39a92 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:56.658987 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510b1dd-f20d-4c5f-901a-f8bc56f39a92 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:56.663566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f81595-9cf8-4135-b383-f6d491c4bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:56.664150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f81595-9cf8-4135-b383-f6d491c4bb77 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.664430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f81595-9cf8-4135-b383-f6d491c4bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.664725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f81595-9cf8-4135-b383-f6d491c4bb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.665351 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f81595-9cf8-4135-b383-f6d491c4bb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:56.667278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f81595-9cf8-4135-b383-f6d491c4bb77 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:56.693330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1234/2495] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:53:56 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:56.697881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:56.707782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b929d-c055-433c-8205-f88aa0663315 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:56.763030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ead3d-8cb8-45fa-b0e9-76826c12a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:56.763653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ead3d-8cb8-45fa-b0e9-76826c12a4ab admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.763936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ead3d-8cb8-45fa-b0e9-76826c12a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.764209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ead3d-8cb8-45fa-b0e9-76826c12a4ab admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.764867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ead3d-8cb8-45fa-b0e9-76826c12a4ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:56.766820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ead3d-8cb8-45fa-b0e9-76826c12a4ab admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:56.788535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1262/2496] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:53:56 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:56.792599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f81595-9cf8-4135-b383-f6d491c4bb77 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:56.802645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f81595-9cf8-4135-b383-f6d491c4bb77 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:56.807254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60fc41-ec3a-4f5a-839f-088ad7956110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:56.807849 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60fc41-ec3a-4f5a-839f-088ad7956110 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.808133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60fc41-ec3a-4f5a-839f-088ad7956110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.808406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60fc41-ec3a-4f5a-839f-088ad7956110 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.809039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60fc41-ec3a-4f5a-839f-088ad7956110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:56.810671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60fc41-ec3a-4f5a-839f-088ad7956110 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:56.820844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1235/2497] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:56.824554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ead3d-8cb8-45fa-b0e9-76826c12a4ab admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:56.835016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ead3d-8cb8-45fa-b0e9-76826c12a4ab admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:56.839633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91ce2e-75af-4968-9fe6-bd744951bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:56.840220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91ce2e-75af-4968-9fe6-bd744951bab5 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.840508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91ce2e-75af-4968-9fe6-bd744951bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.840779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91ce2e-75af-4968-9fe6-bd744951bab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.841441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91ce2e-75af-4968-9fe6-bd744951bab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:56.843091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91ce2e-75af-4968-9fe6-bd744951bab5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:56.853506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1263/2498] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:56.857469 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60fc41-ec3a-4f5a-839f-088ad7956110 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:56.868427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60fc41-ec3a-4f5a-839f-088ad7956110 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:56.872999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96ed46-52cd-4812-914c-d8338fa25a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:56.873661 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96ed46-52cd-4812-914c-d8338fa25a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.873951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96ed46-52cd-4812-914c-d8338fa25a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.874232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96ed46-52cd-4812-914c-d8338fa25a4a admin admin] PATH_INFO: `/v3/projects/34e56788b72f444ba2065b1617b0c72c/users/40e312813fac48baa1f83ffe5565b73b/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.889811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96ed46-52cd-4812-914c-d8338fa25a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e56788b72f444ba2065b1617b0c72c, user_id=40e312813fac48baa1f83ffe5565b73b, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:56.892462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96ed46-52cd-4812-914c-d8338fa25a4a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:56.905583 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1236/2499] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:56 2022] PUT /identity/v3/projects/34e56788b72f444ba2065b1617b0c72c/users/40e312813fac48baa1f83ffe5565b73b/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:56.917170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b368-c476-4bb8-9cdf-8edbe3326909 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:56.917458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b368-c476-4bb8-9cdf-8edbe3326909 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:56.917768 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b368-c476-4bb8-9cdf-8edbe3326909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:56.945528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9e39b368-c476-4bb8-9cdf-8edbe3326909 None None] MFA Rules not processed for user `40e312813fac48baa1f83ffe5565b73b`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:56.946761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9e39b368-c476-4bb8-9cdf-8edbe3326909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:57.008731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1264/2500] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:57.013145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96ed46-52cd-4812-914c-d8338fa25a4a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:57.073541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96ed46-52cd-4812-914c-d8338fa25a4a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:57.078250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d87030-d43f-46a9-88b8-b9c2eff9acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:57.078844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d87030-d43f-46a9-88b8-b9c2eff9acda admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:57.079125 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d87030-d43f-46a9-88b8-b9c2eff9acda admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:57.079399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d87030-d43f-46a9-88b8-b9c2eff9acda admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:57.080014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d87030-d43f-46a9-88b8-b9c2eff9acda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:57.081951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d87030-d43f-46a9-88b8-b9c2eff9acda admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:57.108963 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1237/2501] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:53:57 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:57.113083 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b368-c476-4bb8-9cdf-8edbe3326909 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:57.119070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:57.125992 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b368-c476-4bb8-9cdf-8edbe3326909 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:57.182148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da482c-2be8-4b9c-ac78-5863359f254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:57.182753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da482c-2be8-4b9c-ac78-5863359f254d admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:57.183036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da482c-2be8-4b9c-ac78-5863359f254d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:57.183319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da482c-2be8-4b9c-ac78-5863359f254d admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:57.183961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da482c-2be8-4b9c-ac78-5863359f254d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:57.185999 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da482c-2be8-4b9c-ac78-5863359f254d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:57.206913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1265/2502] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:53:57 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:53:57.210890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d87030-d43f-46a9-88b8-b9c2eff9acda admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:57.220795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d87030-d43f-46a9-88b8-b9c2eff9acda admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:57.225320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8286-44de-4ced-a8cc-ac85314afa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:57.225938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8286-44de-4ced-a8cc-ac85314afa8e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:57.226213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8286-44de-4ced-a8cc-ac85314afa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:57.226480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c8286-44de-4ced-a8cc-ac85314afa8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:57.227126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8286-44de-4ced-a8cc-ac85314afa8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:57.228706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c8286-44de-4ced-a8cc-ac85314afa8e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:57.238848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1238/2503] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:57.243137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da482c-2be8-4b9c-ac78-5863359f254d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:57.252795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da482c-2be8-4b9c-ac78-5863359f254d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:57.258061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6704e2c-0dd7-48ad-a385-1bc30d0a8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:57.258700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704e2c-0dd7-48ad-a385-1bc30d0a8139 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:57.259035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704e2c-0dd7-48ad-a385-1bc30d0a8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:57.259265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704e2c-0dd7-48ad-a385-1bc30d0a8139 admin admin] PATH_INFO: `/v3/projects/bc6a3f73262545958cf83fd415dfb02d/users/521d44612c8f4bdd956dbf4f90df62e0/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:57.273935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6704e2c-0dd7-48ad-a385-1bc30d0a8139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6a3f73262545958cf83fd415dfb02d, user_id=521d44612c8f4bdd956dbf4f90df62e0, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:57.276606 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6704e2c-0dd7-48ad-a385-1bc30d0a8139 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:57.289675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1266/2504] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:57 2022] PUT /identity/v3/projects/bc6a3f73262545958cf83fd415dfb02d/users/521d44612c8f4bdd956dbf4f90df62e0/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:53:57.293460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8286-44de-4ced-a8cc-ac85314afa8e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:57.303942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c8286-44de-4ced-a8cc-ac85314afa8e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:57.326707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:57.359944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998568c7-c224-4da1-8c5c-7713fbceac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:57.360547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998568c7-c224-4da1-8c5c-7713fbceac23 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:57.360831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998568c7-c224-4da1-8c5c-7713fbceac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:57.361105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998568c7-c224-4da1-8c5c-7713fbceac23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:57.361769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998568c7-c224-4da1-8c5c-7713fbceac23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:57.363362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998568c7-c224-4da1-8c5c-7713fbceac23 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:57.373798 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1239/2505] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:57.377894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6704e2c-0dd7-48ad-a385-1bc30d0a8139 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:57.387921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6704e2c-0dd7-48ad-a385-1bc30d0a8139 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:57.392497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:57.393144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:57.393723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:57.394003 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] PATH_INFO: `/v3/projects/bc6a3f73262545958cf83fd415dfb02d/users/521d44612c8f4bdd956dbf4f90df62e0/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:57.395913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6a3f73262545958cf83fd415dfb02d, user_id=521d44612c8f4bdd956dbf4f90df62e0, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:57.398642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:57.408562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1267/2506] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:57 2022] PUT /identity/v3/projects/bc6a3f73262545958cf83fd415dfb02d/users/521d44612c8f4bdd956dbf4f90df62e0/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:57.419819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a490b2c-29d9-4b83-bd8f-c375df94a6b5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:57.419819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a490b2c-29d9-4b83-bd8f-c375df94a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:57.419819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a490b2c-29d9-4b83-bd8f-c375df94a6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:57.448009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3a490b2c-29d9-4b83-bd8f-c375df94a6b5 None None] MFA Rules not processed for user `521d44612c8f4bdd956dbf4f90df62e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:57.449212 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3a490b2c-29d9-4b83-bd8f-c375df94a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:57.516136 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1240/2507] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:57.527140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:57.528857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:57.585163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b812b-1ef1-4f3d-8b34-d0f5130356d2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:57.588784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bfc65-8c62-4a4c-bb32-6a25f3d535e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:57.589383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bfc65-8c62-4a4c-bb32-6a25f3d535e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:57.589693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bfc65-8c62-4a4c-bb32-6a25f3d535e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:57.590005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bfc65-8c62-4a4c-bb32-6a25f3d535e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:57.599098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bfc65-8c62-4a4c-bb32-6a25f3d535e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:57.601038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bfc65-8c62-4a4c-bb32-6a25f3d535e7 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:57.610507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1268/2508] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:53:57.983303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a490b2c-29d9-4b83-bd8f-c375df94a6b5 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:58.048352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a490b2c-29d9-4b83-bd8f-c375df94a6b5 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:58.054156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:58.054797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:58.055697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:58.055983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] PATH_INFO: `/v3/users/40e312813fac48baa1f83ffe5565b73b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:58.057624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e312813fac48baa1f83ffe5565b73b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:58.059550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:58.108674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e312813fac48baa1f83ffe5565b73b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.109332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e312813fac48baa1f83ffe5565b73b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.112377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:58.117954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e312813fac48baa1f83ffe5565b73b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.118680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e312813fac48baa1f83ffe5565b73b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.127646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e312813fac48baa1f83ffe5565b73b'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.147440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1241/2509] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:53:57 2022] DELETE /identity/v3/users/40e312813fac48baa1f83ffe5565b73b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:58.151890 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ed94-7e0b-4d60-a95e-d03bfaf8fbba None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:58.152355 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ed94-7e0b-4d60-a95e-d03bfaf8fbba None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:58.152713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ed94-7e0b-4d60-a95e-d03bfaf8fbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:58.172768 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0fa0ed94-7e0b-4d60-a95e-d03bfaf8fbba None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:58.173907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0fa0ed94-7e0b-4d60-a95e-d03bfaf8fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:58.347438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:58.357562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1269/2510] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:58.367387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:58.368788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:58.425756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309fc79-5843-4d09-a61e-587fa62cb054 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:58.429817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76709c-3ab0-4c20-807d-2ef29532f274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:58.430415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76709c-3ab0-4c20-807d-2ef29532f274 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:58.430691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76709c-3ab0-4c20-807d-2ef29532f274 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:58.430957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76709c-3ab0-4c20-807d-2ef29532f274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:58.439629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76709c-3ab0-4c20-807d-2ef29532f274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:58.441051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76709c-3ab0-4c20-807d-2ef29532f274 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:58.450794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1242/2511] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:53:58.724633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ed94-7e0b-4d60-a95e-d03bfaf8fbba None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:58.727267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0fa0ed94-7e0b-4d60-a95e-d03bfaf8fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:58.739783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ed94-7e0b-4d60-a95e-d03bfaf8fbba None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:58.745100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:58.745754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:58.746031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:58.746324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] PATH_INFO: `/v3/projects/34e56788b72f444ba2065b1617b0c72c` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:58.747649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e56788b72f444ba2065b1617b0c72c)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:58.749538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:58.809622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e56788b72f444ba2065b1617b0c72c', 'request_id': 'req-9f4b3701-b8e1-41d8-97a1-5489c628925d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.815058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e56788b72f444ba2065b1617b0c72c', 'request_id': 'req-9f4b3701-b8e1-41d8-97a1-5489c628925d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.829186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e56788b72f444ba2065b1617b0c72c', 'request_id': 'req-9f4b3701-b8e1-41d8-97a1-5489c628925d'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.846326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] The token cache is being invalidate because project 34e56788b72f444ba2065b1617b0c72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:53:58.846618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.847405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9f4b3701-b8e1-41d8-97a1-5489c628925d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.848912 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1270/2512] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:53:58 2022] DELETE /identity/v3/projects/34e56788b72f444ba2065b1617b0c72c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:58.853523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76709c-3ab0-4c20-807d-2ef29532f274 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:58.864870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76709c-3ab0-4c20-807d-2ef29532f274 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:58.933570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:58.934303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:58.934660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:58.935002 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] PATH_INFO: `/v3/users/521d44612c8f4bdd956dbf4f90df62e0` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:58.936234 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=521d44612c8f4bdd956dbf4f90df62e0)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:58.938291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:58.938801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e113-17b7-4bc8-92dc-1e1b976d114f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:58.939152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e113-17b7-4bc8-92dc-1e1b976d114f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:58.939275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e113-17b7-4bc8-92dc-1e1b976d114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:58.960082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d909e113-17b7-4bc8-92dc-1e1b976d114f None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:58.961337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d909e113-17b7-4bc8-92dc-1e1b976d114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:58.997205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521d44612c8f4bdd956dbf4f90df62e0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:58.997893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521d44612c8f4bdd956dbf4f90df62e0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.005729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521d44612c8f4bdd956dbf4f90df62e0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.007359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521d44612c8f4bdd956dbf4f90df62e0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.014771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521d44612c8f4bdd956dbf4f90df62e0'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.023226 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:59.024726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1271/2513] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:59.036102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1243/2514] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:53:58 2022] DELETE /identity/v3/users/521d44612c8f4bdd956dbf4f90df62e0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:53:59.074631 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909e113-17b7-4bc8-92dc-1e1b976d114f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:59.076028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d909e113-17b7-4bc8-92dc-1e1b976d114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:59.149687 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909e113-17b7-4bc8-92dc-1e1b976d114f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:59.175558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:59.214810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984be11-666e-4a49-ac4e-b71845052840 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:59.215416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984be11-666e-4a49-ac4e-b71845052840 service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.215722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984be11-666e-4a49-ac4e-b71845052840 service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.215990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984be11-666e-4a49-ac4e-b71845052840 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.272578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984be11-666e-4a49-ac4e-b71845052840 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:59.274289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984be11-666e-4a49-ac4e-b71845052840 service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:59.282996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1272/2515] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:53:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:53:59.317330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:59.320737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:59.421704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14755-bd96-4c05-881d-250875aa0ece admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:59.426821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:59.427758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.428291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.428565 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] PATH_INFO: `/v3/projects/bc6a3f73262545958cf83fd415dfb02d` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.429733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6a3f73262545958cf83fd415dfb02d)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:59.431645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:59.490619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6a3f73262545958cf83fd415dfb02d', 'request_id': 'req-015ede7a-2a1c-45ea-8d0f-f8d2877be192'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.497052 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6a3f73262545958cf83fd415dfb02d', 'request_id': 'req-015ede7a-2a1c-45ea-8d0f-f8d2877be192'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.507441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6a3f73262545958cf83fd415dfb02d', 'request_id': 'req-015ede7a-2a1c-45ea-8d0f-f8d2877be192'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.523956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] The token cache is being invalidate because project bc6a3f73262545958cf83fd415dfb02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:53:59.524392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.525253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-015ede7a-2a1c-45ea-8d0f-f8d2877be192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:53:59.527231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1244/2516] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:53:59 2022] DELETE /identity/v3/projects/bc6a3f73262545958cf83fd415dfb02d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:53:59.532777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dec5f-f587-439c-bb3a-3f586538b84e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.533066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dec5f-f587-439c-bb3a-3f586538b84e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.533332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dec5f-f587-439c-bb3a-3f586538b84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.555616 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-204dec5f-f587-439c-bb3a-3f586538b84e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:59.556914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-204dec5f-f587-439c-bb3a-3f586538b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:59.625464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1273/2517] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:59.633781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5f20a-d574-49cb-940b-fa9066b3ba5a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.634072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5f20a-d574-49cb-940b-fa9066b3ba5a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.634350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5f20a-d574-49cb-940b-fa9066b3ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.657205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-34b5f20a-d574-49cb-940b-fa9066b3ba5a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:53:59.658815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-34b5f20a-d574-49cb-940b-fa9066b3ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:53:59.668821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1245/2518] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:53:59.673145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dec5f-f587-439c-bb3a-3f586538b84e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:59.685540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dec5f-f587-439c-bb3a-3f586538b84e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:59.690408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:59.691012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.691286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.691550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.692192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:53:59.692492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:59.694651 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:59.708544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1274/2519] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:53:59.713505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5f20a-d574-49cb-940b-fa9066b3ba5a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:59.725039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5f20a-d574-49cb-940b-fa9066b3ba5a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:59.730100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704ef31-c3d5-4cd8-b71a-0f334896e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:59.730703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704ef31-c3d5-4cd8-b71a-0f334896e073 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.730978 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704ef31-c3d5-4cd8-b71a-0f334896e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.731249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704ef31-c3d5-4cd8-b71a-0f334896e073 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.731884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704ef31-c3d5-4cd8-b71a-0f334896e073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:59.733815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704ef31-c3d5-4cd8-b71a-0f334896e073 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:59.767407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1246/2520] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:53:59 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:53:59.772498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:59.785560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99478a6-1d1f-4bb5-9efe-56be3145993f admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:59.848330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:53:59.853535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b625b38-5580-4a73-9236-e525021f7d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:59.854439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b625b38-5580-4a73-9236-e525021f7d2c admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.855027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b625b38-5580-4a73-9236-e525021f7d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.855564 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b625b38-5580-4a73-9236-e525021f7d2c admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.856553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b625b38-5580-4a73-9236-e525021f7d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:59.858671 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b625b38-5580-4a73-9236-e525021f7d2c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:59.884187 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1275/2521] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:53:59 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:53:59.888063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704ef31-c3d5-4cd8-b71a-0f334896e073 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:59.903389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704ef31-c3d5-4cd8-b71a-0f334896e073 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:59.908622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6640-1771-41ad-a304-750ec71352db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:59.909352 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6640-1771-41ad-a304-750ec71352db admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.909771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6640-1771-41ad-a304-750ec71352db admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.910167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6640-1771-41ad-a304-750ec71352db admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.910913 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d6640-1771-41ad-a304-750ec71352db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:59.912751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d6640-1771-41ad-a304-750ec71352db admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:59.928836 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1247/2522] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:59.930168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b625b38-5580-4a73-9236-e525021f7d2c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:59.948277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b625b38-5580-4a73-9236-e525021f7d2c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:53:59.953243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd48d3-e9f2-4e86-a4a2-0cb524272fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:53:59.954032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd48d3-e9f2-4e86-a4a2-0cb524272fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:53:59.954382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd48d3-e9f2-4e86-a4a2-0cb524272fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:53:59.954753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd48d3-e9f2-4e86-a4a2-0cb524272fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:53:59.955470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd48d3-e9f2-4e86-a4a2-0cb524272fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:53:59.957134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd48d3-e9f2-4e86-a4a2-0cb524272fa3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:53:59.969011 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1276/2523] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:53:59.972961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6640-1771-41ad-a304-750ec71352db admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:53:59.994626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6640-1771-41ad-a304-750ec71352db admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:00.009606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:00.010422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:00.011079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:00.011768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] PATH_INFO: `/v3/projects/7833cfecedb549c9b5a8b21ddf4251e7/users/a17371329af84cdf8d029df79c6ddaf1/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:00.032374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7833cfecedb549c9b5a8b21ddf4251e7, user_id=a17371329af84cdf8d029df79c6ddaf1, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:00.035944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:00.064101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1248/2524] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:53:59 2022] PUT /identity/v3/projects/7833cfecedb549c9b5a8b21ddf4251e7/users/a17371329af84cdf8d029df79c6ddaf1/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:54:00.080475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45b90-da46-4d80-ac7a-6c9ffef36051 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:00.080884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45b90-da46-4d80-ac7a-6c9ffef36051 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:00.081296 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45b90-da46-4d80-ac7a-6c9ffef36051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:00.154452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6cd45b90-da46-4d80-ac7a-6c9ffef36051 None None] MFA Rules not processed for user `a17371329af84cdf8d029df79c6ddaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:00.160113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6cd45b90-da46-4d80-ac7a-6c9ffef36051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:00.279391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1277/2525] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:00.295051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:00.297421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:00.332497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:00.382033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c3250-ae96-4790-b52c-b1ebd8543231 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:00.389090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972d960-4446-4d04-8535-67f348bf3c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:00.390338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972d960-4446-4d04-8535-67f348bf3c0f service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:00.390625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972d960-4446-4d04-8535-67f348bf3c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:00.390939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972d960-4446-4d04-8535-67f348bf3c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:00.400371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972d960-4446-4d04-8535-67f348bf3c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:00.401851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972d960-4446-4d04-8535-67f348bf3c0f service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:00.416219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1249/2526] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:00.446639 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45b90-da46-4d80-ac7a-6c9ffef36051 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:00.520723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45b90-da46-4d80-ac7a-6c9ffef36051 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:00.528137 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:00.528786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:00.529071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:00.529349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] PATH_INFO: `/v3/users/a17371329af84cdf8d029df79c6ddaf1` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:00.530532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17371329af84cdf8d029df79c6ddaf1)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:00.532448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:00.590893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17371329af84cdf8d029df79c6ddaf1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:00.592521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17371329af84cdf8d029df79c6ddaf1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:00.604356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17371329af84cdf8d029df79c6ddaf1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:00.605077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17371329af84cdf8d029df79c6ddaf1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:00.619688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:00.625200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17371329af84cdf8d029df79c6ddaf1'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:00.641872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1278/2527] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:00 2022] DELETE /identity/v3/users/a17371329af84cdf8d029df79c6ddaf1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:00.646625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106be3e-8662-4ce6-910c-6a19be332271 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:00.647595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106be3e-8662-4ce6-910c-6a19be332271 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:00.647718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106be3e-8662-4ce6-910c-6a19be332271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:00.668707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-1106be3e-8662-4ce6-910c-6a19be332271 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:00.670000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1106be3e-8662-4ce6-910c-6a19be332271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:00.746475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1250/2528] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:00.757233 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:00.758786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:00.824211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ed780-5059-4b59-a068-f4c6b5a0c9b0 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:00.828080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e1454-b524-4fb1-b302-f8146343ef1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:00.828779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1454-b524-4fb1-b302-f8146343ef1f service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:00.829130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1454-b524-4fb1-b302-f8146343ef1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:00.829507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1454-b524-4fb1-b302-f8146343ef1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:00.839879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e1454-b524-4fb1-b302-f8146343ef1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:00.841800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e1454-b524-4fb1-b302-f8146343ef1f service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:00.852698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1279/2529] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:01.156346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106be3e-8662-4ce6-910c-6a19be332271 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:01.158251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1106be3e-8662-4ce6-910c-6a19be332271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:01.178149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106be3e-8662-4ce6-910c-6a19be332271 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:01.183072 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:01.183572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.183949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.184321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] PATH_INFO: `/v3/projects/7833cfecedb549c9b5a8b21ddf4251e7` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.185705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7833cfecedb549c9b5a8b21ddf4251e7)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:01.187760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:01.244876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7833cfecedb549c9b5a8b21ddf4251e7', 'request_id': 'req-aac4c057-b3c1-4a9c-81e6-01660a20abf1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:01.251644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7833cfecedb549c9b5a8b21ddf4251e7', 'request_id': 'req-aac4c057-b3c1-4a9c-81e6-01660a20abf1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:01.260720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7833cfecedb549c9b5a8b21ddf4251e7', 'request_id': 'req-aac4c057-b3c1-4a9c-81e6-01660a20abf1'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:01.279517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] The token cache is being invalidate because project 7833cfecedb549c9b5a8b21ddf4251e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:01.280080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:01.280974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:01.282656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1251/2530] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:01 2022] DELETE /identity/v3/projects/7833cfecedb549c9b5a8b21ddf4251e7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:01.288413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc865-6204-4264-9cd9-363ef30dbe43 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.288888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc865-6204-4264-9cd9-363ef30dbe43 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.289276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc865-6204-4264-9cd9-363ef30dbe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.310821 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8abdc865-6204-4264-9cd9-363ef30dbe43 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:01.312044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8abdc865-6204-4264-9cd9-363ef30dbe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:01.386786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:01.388655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:01.412275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1280/2531] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:01.417100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c542a3-f438-4484-8bb9-66b158f9f5db None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.417100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c542a3-f438-4484-8bb9-66b158f9f5db None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.417100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c542a3-f438-4484-8bb9-66b158f9f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.457235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:01.459991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-16c542a3-f438-4484-8bb9-66b158f9f5db None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:01.461896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-16c542a3-f438-4484-8bb9-66b158f9f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:01.469853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4c057-b3c1-4a9c-81e6-01660a20abf1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:01.474938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:01.476020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.476548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.477124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.480896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:01.481774 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1281/2532] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:01.483017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c542a3-f438-4484-8bb9-66b158f9f5db None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:01.493976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c542a3-f438-4484-8bb9-66b158f9f5db None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:01.499660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:01.500986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.501429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.502036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.503522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:54:01.504138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:01.505957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:01.521075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1282/2533] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:54:01.525717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:01.536484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3fe90-d794-46e3-a0b0-4cf12c96a8c3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:01.542533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce992b2-bc25-45c2-b2c6-681fc02a74ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:01.543275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce992b2-bc25-45c2-b2c6-681fc02a74ea admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.543927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce992b2-bc25-45c2-b2c6-681fc02a74ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.544315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce992b2-bc25-45c2-b2c6-681fc02a74ea admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.545487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce992b2-bc25-45c2-b2c6-681fc02a74ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:01.549782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce992b2-bc25-45c2-b2c6-681fc02a74ea admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:01.581542 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:01.583498 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:01.585922 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1283/2534] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:01 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:01.589621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce992b2-bc25-45c2-b2c6-681fc02a74ea admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:01.598171 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1252/2535] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:01.672899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:01.698624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce992b2-bc25-45c2-b2c6-681fc02a74ea admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:01.709181 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b0917-19fa-4813-a8be-cfaa10d0f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:01.710036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0917-19fa-4813-a8be-cfaa10d0f0ec admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.710427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0917-19fa-4813-a8be-cfaa10d0f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.710808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0917-19fa-4813-a8be-cfaa10d0f0ec admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.711553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b0917-19fa-4813-a8be-cfaa10d0f0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:01.713624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b0917-19fa-4813-a8be-cfaa10d0f0ec admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:01.761225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1284/2536] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:01 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:01.765007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:01.776838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd6e2-9da2-44ec-a228-fcbfe3ae8562 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:01.784089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3efe89-f2ce-4c93-acf7-4c663bea2490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:01.785006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efe89-f2ce-4c93-acf7-4c663bea2490 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.785291 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efe89-f2ce-4c93-acf7-4c663bea2490 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.785570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efe89-f2ce-4c93-acf7-4c663bea2490 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.786246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3efe89-f2ce-4c93-acf7-4c663bea2490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:01.788384 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3efe89-f2ce-4c93-acf7-4c663bea2490 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:01.802173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1253/2537] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:01.806723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b0917-19fa-4813-a8be-cfaa10d0f0ec admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:01.817542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b0917-19fa-4813-a8be-cfaa10d0f0ec admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:01.822530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b70de7-5ddb-475d-8668-c392ee4f1a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:01.823339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70de7-5ddb-475d-8668-c392ee4f1a5a admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.823825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70de7-5ddb-475d-8668-c392ee4f1a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.824197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b70de7-5ddb-475d-8668-c392ee4f1a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.824933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b70de7-5ddb-475d-8668-c392ee4f1a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:01.826648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b70de7-5ddb-475d-8668-c392ee4f1a5a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:01.840394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1285/2538] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:54:01.841547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3efe89-f2ce-4c93-acf7-4c663bea2490 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:01.853106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3efe89-f2ce-4c93-acf7-4c663bea2490 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:01.861701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc8eb5-2c9d-4190-8606-c77f1f48b9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:01.862372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc8eb5-2c9d-4190-8606-c77f1f48b9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.862649 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc8eb5-2c9d-4190-8606-c77f1f48b9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.862918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc8eb5-2c9d-4190-8606-c77f1f48b9d6 admin admin] PATH_INFO: `/v3/projects/fce40048ceb34a5e92e370d857d3b2c3/users/66f667b4314e458c82ca87f2656f455a/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.883547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc8eb5-2c9d-4190-8606-c77f1f48b9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce40048ceb34a5e92e370d857d3b2c3, user_id=66f667b4314e458c82ca87f2656f455a, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:01.886308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc8eb5-2c9d-4190-8606-c77f1f48b9d6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:01.901869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1254/2539] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:01 2022] PUT /identity/v3/projects/fce40048ceb34a5e92e370d857d3b2c3/users/66f667b4314e458c82ca87f2656f455a/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:01.912727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7ad20-15e5-4ac5-8554-1e80ebf19af5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:01.913309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7ad20-15e5-4ac5-8554-1e80ebf19af5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:01.913807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7ad20-15e5-4ac5-8554-1e80ebf19af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:01.944016 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-36a7ad20-15e5-4ac5-8554-1e80ebf19af5 None None] MFA Rules not processed for user `66f667b4314e458c82ca87f2656f455a`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:01.945208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-36a7ad20-15e5-4ac5-8554-1e80ebf19af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:02.020761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1286/2540] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:54:02.021889 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc8eb5-2c9d-4190-8606-c77f1f48b9d6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.089158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc8eb5-2c9d-4190-8606-c77f1f48b9d6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.094432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60aa3b-b377-4082-b405-5f4b5801e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.095074 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60aa3b-b377-4082-b405-5f4b5801e4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.095362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60aa3b-b377-4082-b405-5f4b5801e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.095639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60aa3b-b377-4082-b405-5f4b5801e4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.096296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60aa3b-b377-4082-b405-5f4b5801e4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.098387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60aa3b-b377-4082-b405-5f4b5801e4d0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.133048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1255/2541] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:02 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:02.136963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7ad20-15e5-4ac5-8554-1e80ebf19af5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.150460 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7ad20-15e5-4ac5-8554-1e80ebf19af5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.228170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089b505-f032-4afb-a6bc-2453f447d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.228778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089b505-f032-4afb-a6bc-2453f447d2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.229079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089b505-f032-4afb-a6bc-2453f447d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.229345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089b505-f032-4afb-a6bc-2453f447d2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.230072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089b505-f032-4afb-a6bc-2453f447d2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.231993 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089b505-f032-4afb-a6bc-2453f447d2a3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.261029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1287/2542] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:02 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:02.266760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60aa3b-b377-4082-b405-5f4b5801e4d0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.278973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60aa3b-b377-4082-b405-5f4b5801e4d0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.284308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613b7cb-c6a3-4248-8da1-3bf73c082d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.284931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613b7cb-c6a3-4248-8da1-3bf73c082d01 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.285220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613b7cb-c6a3-4248-8da1-3bf73c082d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.285528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613b7cb-c6a3-4248-8da1-3bf73c082d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.286225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613b7cb-c6a3-4248-8da1-3bf73c082d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.292942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613b7cb-c6a3-4248-8da1-3bf73c082d01 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.305659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1256/2543] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:02.310028 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089b505-f032-4afb-a6bc-2453f447d2a3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.321413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089b505-f032-4afb-a6bc-2453f447d2a3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.326393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4420a-35c1-4dc8-93ee-6be4fef21f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.327081 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4420a-35c1-4dc8-93ee-6be4fef21f8e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.327426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4420a-35c1-4dc8-93ee-6be4fef21f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.327765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4420a-35c1-4dc8-93ee-6be4fef21f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.328495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4420a-35c1-4dc8-93ee-6be4fef21f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.330786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4420a-35c1-4dc8-93ee-6be4fef21f8e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.342619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1288/2544] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:02.346908 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613b7cb-c6a3-4248-8da1-3bf73c082d01 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.358075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613b7cb-c6a3-4248-8da1-3bf73c082d01 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.362982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52681-7e01-477c-9ab2-b5c23bf2c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.363748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52681-7e01-477c-9ab2-b5c23bf2c6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.364098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52681-7e01-477c-9ab2-b5c23bf2c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.364440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52681-7e01-477c-9ab2-b5c23bf2c6ae admin admin] PATH_INFO: `/v3/projects/05ed1479c0034303a37ad5e1017bb489/users/3f249245fafd415d92538320c8bbe208/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.381313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52681-7e01-477c-9ab2-b5c23bf2c6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ed1479c0034303a37ad5e1017bb489, user_id=3f249245fafd415d92538320c8bbe208, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.384141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52681-7e01-477c-9ab2-b5c23bf2c6ae admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.397489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:02.407747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1257/2545] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:02 2022] PUT /identity/v3/projects/05ed1479c0034303a37ad5e1017bb489/users/3f249245fafd415d92538320c8bbe208/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:02.419969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ae03-7421-496b-9a3b-3a31000d5d22 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.420700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ae03-7421-496b-9a3b-3a31000d5d22 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.420700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7ae03-7421-496b-9a3b-3a31000d5d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.456756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-19d7ae03-7421-496b-9a3b-3a31000d5d22 None None] MFA Rules not processed for user `3f249245fafd415d92538320c8bbe208`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:02.458257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-19d7ae03-7421-496b-9a3b-3a31000d5d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:02.481960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:02.535014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1289/2546] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:02.540404 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52681-7e01-477c-9ab2-b5c23bf2c6ae admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.611802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52681-7e01-477c-9ab2-b5c23bf2c6ae admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.617191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b119f-4d3c-48fb-9b4e-665e9f21aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.617852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b119f-4d3c-48fb-9b4e-665e9f21aaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.618141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b119f-4d3c-48fb-9b4e-665e9f21aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.618424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b119f-4d3c-48fb-9b4e-665e9f21aaf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.619066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b119f-4d3c-48fb-9b4e-665e9f21aaf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.621053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b119f-4d3c-48fb-9b4e-665e9f21aaf4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.652120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1258/2547] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:02 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:54:02.656521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7ae03-7421-496b-9a3b-3a31000d5d22 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.670492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7ae03-7421-496b-9a3b-3a31000d5d22 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.732319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d501fed-1c1d-445f-8576-412ac65b77c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.732940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d501fed-1c1d-445f-8576-412ac65b77c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.733224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d501fed-1c1d-445f-8576-412ac65b77c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.733501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d501fed-1c1d-445f-8576-412ac65b77c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.734305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d501fed-1c1d-445f-8576-412ac65b77c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.736273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d501fed-1c1d-445f-8576-412ac65b77c4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.769443 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1290/2548] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:02 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:02.773474 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b119f-4d3c-48fb-9b4e-665e9f21aaf4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.788559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b119f-4d3c-48fb-9b4e-665e9f21aaf4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.793373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.794032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.794317 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.794594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.795298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.796901 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.818142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d501fed-1c1d-445f-8576-412ac65b77c4 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.826824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1259/2549] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:02.832243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d501fed-1c1d-445f-8576-412ac65b77c4 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:02.841900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.844192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a708-0f7d-4eba-8b30-9032f879c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:02.844359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:02.844904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a708-0f7d-4eba-8b30-9032f879c5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:02.845162 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a708-0f7d-4eba-8b30-9032f879c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:02.845439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4a708-0f7d-4eba-8b30-9032f879c5f9 admin admin] PATH_INFO: `/v3/projects/88d1259c6389418da2ce619d1178193b/users/15f70df8903e441a893743646ff14cc2/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:02.872653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4a708-0f7d-4eba-8b30-9032f879c5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d1259c6389418da2ce619d1178193b, user_id=15f70df8903e441a893743646ff14cc2, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:02.876487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4a708-0f7d-4eba-8b30-9032f879c5f9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:02.907150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1291/2550] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:02 2022] PUT /identity/v3/projects/88d1259c6389418da2ce619d1178193b/users/15f70df8903e441a893743646ff14cc2/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:54:02.910799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a708-0f7d-4eba-8b30-9032f879c5f9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:02.942086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80b01a-8260-4c2a-b191-54296af00fa0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:03.028806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:03.029431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:03.029752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:03.030029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:03.036154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:03.045339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4a708-0f7d-4eba-8b30-9032f879c5f9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:03.055227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1295c87-086c-47c9-aa9e-45686f7c62d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:03.055227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1295c87-086c-47c9-aa9e-45686f7c62d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:03.055227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1295c87-086c-47c9-aa9e-45686f7c62d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:03.055227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1295c87-086c-47c9-aa9e-45686f7c62d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:03.055730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1295c87-086c-47c9-aa9e-45686f7c62d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:03.057067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1295c87-086c-47c9-aa9e-45686f7c62d8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:03.072547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1292/2551] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:03.078599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1295c87-086c-47c9-aa9e-45686f7c62d8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:03.096311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1295c87-086c-47c9-aa9e-45686f7c62d8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:03.102515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce88f1a-2045-4085-a330-14a0bf9d7532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:03.103275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce88f1a-2045-4085-a330-14a0bf9d7532 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:03.103724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce88f1a-2045-4085-a330-14a0bf9d7532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:03.104012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce88f1a-2045-4085-a330-14a0bf9d7532 admin admin] PATH_INFO: `/v3/projects/88d1259c6389418da2ce619d1178193b/users/15f70df8903e441a893743646ff14cc2/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:03.106769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce88f1a-2045-4085-a330-14a0bf9d7532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d1259c6389418da2ce619d1178193b, user_id=15f70df8903e441a893743646ff14cc2, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:03.109979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce88f1a-2045-4085-a330-14a0bf9d7532 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:03.119985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:03.133586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1293/2552] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:03 2022] PUT /identity/v3/projects/88d1259c6389418da2ce619d1178193b/users/15f70df8903e441a893743646ff14cc2/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:03.136294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ee727-d7c2-4437-b34a-e893b02077f9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:03.136692 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ee727-d7c2-4437-b34a-e893b02077f9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:03.137119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ee727-d7c2-4437-b34a-e893b02077f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:03.161310 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:03.163171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:03.164124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:03.176098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d71ee727-d7c2-4437-b34a-e893b02077f9 None None] MFA Rules not processed for user `15f70df8903e441a893743646ff14cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:03.176848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1260/2553] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:03.180344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d71ee727-d7c2-4437-b34a-e893b02077f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:03.279791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1294/2554] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:54:03.288161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:03.289683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:03.367116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac59732-445f-4dee-acd6-44c932eea866 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:03.430488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb827bc-e4d2-41fb-8a13-0fd3d2df6c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:03.431115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb827bc-e4d2-41fb-8a13-0fd3d2df6c7d service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:03.431544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb827bc-e4d2-41fb-8a13-0fd3d2df6c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:03.431824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb827bc-e4d2-41fb-8a13-0fd3d2df6c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:03.498968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb827bc-e4d2-41fb-8a13-0fd3d2df6c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:03.500724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb827bc-e4d2-41fb-8a13-0fd3d2df6c7d service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:03.511173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1261/2555] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:05.153622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ee727-d7c2-4437-b34a-e893b02077f9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:05.155033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d71ee727-d7c2-4437-b34a-e893b02077f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:05.167988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ee727-d7c2-4437-b34a-e893b02077f9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:05.174135 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9ea7-3016-4f2c-9910-8875522db096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:05.174758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9ea7-3016-4f2c-9910-8875522db096 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:05.175037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9ea7-3016-4f2c-9910-8875522db096 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:05.175312 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9ea7-3016-4f2c-9910-8875522db096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:05.246621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f9ea7-3016-4f2c-9910-8875522db096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:05.248062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f9ea7-3016-4f2c-9910-8875522db096 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:05.258514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1295/2556] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:05.985102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb827bc-e4d2-41fb-8a13-0fd3d2df6c7d service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:06.003029 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb827bc-e4d2-41fb-8a13-0fd3d2df6c7d service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:06.007672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3338e78-a446-4b77-bc7d-72db5eb6eaca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:06.008350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338e78-a446-4b77-bc7d-72db5eb6eaca service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:06.008700 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338e78-a446-4b77-bc7d-72db5eb6eaca service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:06.009042 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3338e78-a446-4b77-bc7d-72db5eb6eaca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:06.027527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3338e78-a446-4b77-bc7d-72db5eb6eaca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:06.029519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3338e78-a446-4b77-bc7d-72db5eb6eaca service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:06.045328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1262/2557] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:10.074716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9ea7-3016-4f2c-9910-8875522db096 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:10.136072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9ea7-3016-4f2c-9910-8875522db096 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:10.141112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:10.141840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:10.142101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:10.142373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] PATH_INFO: `/v3/users/66f667b4314e458c82ca87f2656f455a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:10.143793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f667b4314e458c82ca87f2656f455a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:10.145747 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:10.183712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:10.192978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f667b4314e458c82ca87f2656f455a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.194211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f667b4314e458c82ca87f2656f455a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.200983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f667b4314e458c82ca87f2656f455a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.201726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f667b4314e458c82ca87f2656f455a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.214273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f667b4314e458c82ca87f2656f455a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.226405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1296/2558] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:10 2022] DELETE /identity/v3/users/66f667b4314e458c82ca87f2656f455a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:10.231739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc228d-ed15-4c8b-8ed5-968d55500c7e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:10.231739 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc228d-ed15-4c8b-8ed5-968d55500c7e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:10.232193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc228d-ed15-4c8b-8ed5-968d55500c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:10.252068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-eabc228d-ed15-4c8b-8ed5-968d55500c7e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:10.253308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-eabc228d-ed15-4c8b-8ed5-968d55500c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:10.276159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:10.328182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1263/2559] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:10.338668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:10.340191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:10.421578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8166e9e-c5c6-4fe8-9f4d-3d34945f68bf admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:10.425222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89c23f-ec3e-4851-93b2-eae6d9ef1572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:10.425941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c23f-ec3e-4851-93b2-eae6d9ef1572 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:10.426307 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c23f-ec3e-4851-93b2-eae6d9ef1572 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:10.426640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89c23f-ec3e-4851-93b2-eae6d9ef1572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:10.437458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89c23f-ec3e-4851-93b2-eae6d9ef1572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:10.438881 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89c23f-ec3e-4851-93b2-eae6d9ef1572 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:10.448762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1297/2560] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:54:10.750919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc228d-ed15-4c8b-8ed5-968d55500c7e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:10.752343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-eabc228d-ed15-4c8b-8ed5-968d55500c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:10.764888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc228d-ed15-4c8b-8ed5-968d55500c7e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:10.769800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:10.770465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:10.770745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:10.771022 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] PATH_INFO: `/v3/projects/fce40048ceb34a5e92e370d857d3b2c3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:10.772198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce40048ceb34a5e92e370d857d3b2c3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:10.774276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:10.821054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce40048ceb34a5e92e370d857d3b2c3', 'request_id': 'req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.826409 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce40048ceb34a5e92e370d857d3b2c3', 'request_id': 'req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.833182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce40048ceb34a5e92e370d857d3b2c3', 'request_id': 'req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.843710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] The token cache is being invalidate because project fce40048ceb34a5e92e370d857d3b2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:10.843997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.844621 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.846114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1264/2561] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:10 2022] DELETE /identity/v3/projects/fce40048ceb34a5e92e370d857d3b2c3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:10.850599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89c23f-ec3e-4851-93b2-eae6d9ef1572 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:10.859769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89c23f-ec3e-4851-93b2-eae6d9ef1572 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:10.914319 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:10.914966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:10.915231 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:10.915506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] PATH_INFO: `/v3/users/3f249245fafd415d92538320c8bbe208` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:10.916619 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f249245fafd415d92538320c8bbe208)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:10.918576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:10.962925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f249245fafd415d92538320c8bbe208'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.963507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f249245fafd415d92538320c8bbe208'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.970414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f249245fafd415d92538320c8bbe208'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.971053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f249245fafd415d92538320c8bbe208'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.972863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:10.985981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f249245fafd415d92538320c8bbe208'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:10.998787 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1298/2562] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:10 2022] DELETE /identity/v3/users/3f249245fafd415d92538320c8bbe208 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:11.261860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:11.263360 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:11.280366 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9c6f5-6005-4dac-aca0-c4f1e44d04e5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:11.335909 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:11.336551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:11.336833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:11.337111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] PATH_INFO: `/v3/projects/05ed1479c0034303a37ad5e1017bb489` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:11.338240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ed1479c0034303a37ad5e1017bb489)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:11.340150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:11.386094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ed1479c0034303a37ad5e1017bb489', 'request_id': 'req-28edbb16-bbe6-4348-b398-f4fdedde9812'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.387990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:11.393748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ed1479c0034303a37ad5e1017bb489', 'request_id': 'req-28edbb16-bbe6-4348-b398-f4fdedde9812'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.401630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ed1479c0034303a37ad5e1017bb489', 'request_id': 'req-28edbb16-bbe6-4348-b398-f4fdedde9812'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.426495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] The token cache is being invalidate because project 05ed1479c0034303a37ad5e1017bb489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:11.426495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.426495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.426495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1265/2563] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:11 2022] DELETE /identity/v3/projects/05ed1479c0034303a37ad5e1017bb489 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:11.428129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:11.429519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:11.442000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f10ec-bb03-4644-9b0a-e0f389e7b6de admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:11.498767 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:11.499389 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:11.499672 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:11.499949 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] PATH_INFO: `/v3/users/15f70df8903e441a893743646ff14cc2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:11.501097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f70df8903e441a893743646ff14cc2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:11.503923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:11.549826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f70df8903e441a893743646ff14cc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.550544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f70df8903e441a893743646ff14cc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.558264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f70df8903e441a893743646ff14cc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.558928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f70df8903e441a893743646ff14cc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.572059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-44e4e338-866b-40b0-b336-f7be2b82436f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f70df8903e441a893743646ff14cc2'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:11.591104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1299/2564] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:11 2022] DELETE /identity/v3/users/15f70df8903e441a893743646ff14cc2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:11.928261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:11.930141 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:11.947185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edbb16-bbe6-4348-b398-f4fdedde9812 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:12.016915 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:12.018080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.018920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.019260 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] PATH_INFO: `/v3/projects/88d1259c6389418da2ce619d1178193b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.021077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d1259c6389418da2ce619d1178193b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:12.024506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:12.086736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d1259c6389418da2ce619d1178193b', 'request_id': 'req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:12.092248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d1259c6389418da2ce619d1178193b', 'request_id': 'req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:12.100144 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d1259c6389418da2ce619d1178193b', 'request_id': 'req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:12.112372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] The token cache is being invalidate because project 88d1259c6389418da2ce619d1178193b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:12.112702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:12.113385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a243dc3b-b5ff-4cc2-bba8-6edf781d3e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:12.114905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1266/2565] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:11 2022] DELETE /identity/v3/projects/88d1259c6389418da2ce619d1178193b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:12.120210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149dec5-210f-4d96-92f1-2f9378da071d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.120515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149dec5-210f-4d96-92f1-2f9378da071d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.120792 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149dec5-210f-4d96-92f1-2f9378da071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.141950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-9149dec5-210f-4d96-92f1-2f9378da071d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:12.143191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9149dec5-210f-4d96-92f1-2f9378da071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:12.192598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:12.205254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1300/2566] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:12.214218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b995a-008a-477e-bbc4-bbe7d45cd167 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.214528 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b995a-008a-477e-bbc4-bbe7d45cd167 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.214802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b995a-008a-477e-bbc4-bbe7d45cd167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.234510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7c0b995a-008a-477e-bbc4-bbe7d45cd167 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:12.235704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7c0b995a-008a-477e-bbc4-bbe7d45cd167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:12.244040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1267/2567] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:12.248225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149dec5-210f-4d96-92f1-2f9378da071d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:12.258148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149dec5-210f-4d96-92f1-2f9378da071d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:12.262627 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:12.263215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.263491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.263760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.264402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:54:12.264700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:12.266324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:12.278486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1301/2568] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:54:12.282662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b995a-008a-477e-bbc4-bbe7d45cd167 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:12.294186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b995a-008a-477e-bbc4-bbe7d45cd167 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:12.299570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b48f-09e8-40f7-bd23-8d379a8fcade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:12.300100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b48f-09e8-40f7-bd23-8d379a8fcade admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.300380 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b48f-09e8-40f7-bd23-8d379a8fcade admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.300656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605b48f-09e8-40f7-bd23-8d379a8fcade admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.301658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b48f-09e8-40f7-bd23-8d379a8fcade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:12.305121 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605b48f-09e8-40f7-bd23-8d379a8fcade admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:12.334118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1268/2569] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:12 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:12.337883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:12.348209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81898-31e6-4ace-98f1-3cb410504e92 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:12.405145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc895ed-c77c-4ec1-80f4-828d3b9307eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:12.405791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc895ed-c77c-4ec1-80f4-828d3b9307eb admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.406079 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc895ed-c77c-4ec1-80f4-828d3b9307eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.406353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc895ed-c77c-4ec1-80f4-828d3b9307eb admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.406988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc895ed-c77c-4ec1-80f4-828d3b9307eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:12.408935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc895ed-c77c-4ec1-80f4-828d3b9307eb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:12.432405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1302/2570] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:12 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:54:12.436605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b48f-09e8-40f7-bd23-8d379a8fcade admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:12.446627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605b48f-09e8-40f7-bd23-8d379a8fcade admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:12.451344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8097-b91b-44d2-8099-06d37479227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:12.451953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8097-b91b-44d2-8099-06d37479227b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.452232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8097-b91b-44d2-8099-06d37479227b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.452507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8097-b91b-44d2-8099-06d37479227b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.453183 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b8097-b91b-44d2-8099-06d37479227b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:12.454845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b8097-b91b-44d2-8099-06d37479227b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:12.464733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1269/2571] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:12.468700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc895ed-c77c-4ec1-80f4-828d3b9307eb admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:12.479906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc895ed-c77c-4ec1-80f4-828d3b9307eb admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:12.484804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b651d-6363-4326-9a66-0e6b007c8529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:12.485441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b651d-6363-4326-9a66-0e6b007c8529 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.485755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b651d-6363-4326-9a66-0e6b007c8529 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.486182 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b651d-6363-4326-9a66-0e6b007c8529 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.486860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b651d-6363-4326-9a66-0e6b007c8529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:12.488557 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b651d-6363-4326-9a66-0e6b007c8529 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:12.501271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1303/2572] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:12.533191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8097-b91b-44d2-8099-06d37479227b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:12.543488 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8097-b91b-44d2-8099-06d37479227b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:12.548087 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:12.548735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.549020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.549724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] PATH_INFO: `/v3/projects/a1d430f404414933994b562fa2cd89d9/users/643d67afd4a64bf4967d1134a84b7d1f/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.563803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d430f404414933994b562fa2cd89d9, user_id=643d67afd4a64bf4967d1134a84b7d1f, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:12.566506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:12.580997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1270/2573] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:12 2022] PUT /identity/v3/projects/a1d430f404414933994b562fa2cd89d9/users/643d67afd4a64bf4967d1134a84b7d1f/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:12.591854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0565-e398-478f-b4a4-b42431d63e41 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.592171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0565-e398-478f-b4a4-b42431d63e41 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.592454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0565-e398-478f-b4a4-b42431d63e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.621047 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4efe0565-e398-478f-b4a4-b42431d63e41 None None] MFA Rules not processed for user `643d67afd4a64bf4967d1134a84b7d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:12.622295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4efe0565-e398-478f-b4a4-b42431d63e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:12.687928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1304/2574] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:12.701818 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:12.703686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:12.714111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:12.762280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56251e4c-7aa3-44eb-894e-9afdeb47dde6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:12.765949 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdb8a57a383c475caff51c3d6d5c6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:12.766572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:12.766840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:12.767116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:12.775530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:12.776964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:12.785563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1271/2575] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:54:16.030764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e9137-7626-422f-8b98-aa430a0097bb None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:16.031223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e9137-7626-422f-8b98-aa430a0097bb None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:16.031390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e9137-7626-422f-8b98-aa430a0097bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:16.051209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a16e9137-7626-422f-8b98-aa430a0097bb None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:16.053099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a16e9137-7626-422f-8b98-aa430a0097bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:16.105100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:16.116546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1305/2576] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:16.129852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:16.131808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:16.200135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c8801-f37d-4886-8281-6fcf77b3ec05 service glance] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:16.205624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:16.206255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:16.206536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:16.206808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:16.216034 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:16.217684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:16.225628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1272/2577] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:54:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:54:22.688446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e9137-7626-422f-8b98-aa430a0097bb None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:22.690119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a16e9137-7626-422f-8b98-aa430a0097bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:22.778435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e9137-7626-422f-8b98-aa430a0097bb None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:22.784923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:22.785893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:22.786191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:22.786448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:22.788903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:22.874467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:22.876158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:22.886058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1306/2578] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:26.222345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=55 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:26.932668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:26.934095 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:26.989033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf23ff-302c-4cf5-be4d-2cdbf3245b45 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:26.993241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74332c70-be28-478f-88e5-fcf689422f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:26.993896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74332c70-be28-478f-88e5-fcf689422f81 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:26.994180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74332c70-be28-478f-88e5-fcf689422f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:26.994454 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74332c70-be28-478f-88e5-fcf689422f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:26.996229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-74332c70-be28-478f-88e5-fcf689422f81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:27.053154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74332c70-be28-478f-88e5-fcf689422f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:27.054623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74332c70-be28-478f-88e5-fcf689422f81 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:27.063478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1273/2579] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:30.414482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:30.415916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:30.502503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c11ddc-14f0-4c4b-af61-00808b6e9c68 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:30.507169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:30.511634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:30.513864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:30.514322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:30.516918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:30.529393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:30.531403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:30.541223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1307/2580] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:32.275540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c4329-2a6f-4de9-bfe2-a8ff73f75276 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:32.276077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c4329-2a6f-4de9-bfe2-a8ff73f75276 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:32.276077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c4329-2a6f-4de9-bfe2-a8ff73f75276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:32.297438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-612c4329-2a6f-4de9-bfe2-a8ff73f75276 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:32.298740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-612c4329-2a6f-4de9-bfe2-a8ff73f75276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:32.306475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1274/2581] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 4 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:32.320055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:32.332917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64092293-6958-44f0-afbf-4fc447c8c0aa service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:32.339007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8cf8b-2737-411b-a1f6-d03cc7cddaaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:32.339714 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8cf8b-2737-411b-a1f6-d03cc7cddaaf service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:32.340036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8cf8b-2737-411b-a1f6-d03cc7cddaaf service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:32.340327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8cf8b-2737-411b-a1f6-d03cc7cddaaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:32.349643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8cf8b-2737-411b-a1f6-d03cc7cddaaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:32.351655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8cf8b-2737-411b-a1f6-d03cc7cddaaf service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:32.360216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1308/2582] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:54:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 12:54:34.529982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c4329-2a6f-4de9-bfe2-a8ff73f75276 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:34.590679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c4329-2a6f-4de9-bfe2-a8ff73f75276 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:34.595194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:34.595823 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:34.596107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:34.596382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] PATH_INFO: `/v3/users/643d67afd4a64bf4967d1134a84b7d1f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:34.597510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=643d67afd4a64bf4967d1134a84b7d1f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:34.599470 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:34.649537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643d67afd4a64bf4967d1134a84b7d1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:34.650232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643d67afd4a64bf4967d1134a84b7d1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:34.652700 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:34.658334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643d67afd4a64bf4967d1134a84b7d1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:34.659116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643d67afd4a64bf4967d1134a84b7d1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:34.666841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643d67afd4a64bf4967d1134a84b7d1f'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:34.684326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1275/2583] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:34 2022] DELETE /identity/v3/users/643d67afd4a64bf4967d1134a84b7d1f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:34.688737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755546-a5da-4ab0-8f8e-e8afc72a2490 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:34.689207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755546-a5da-4ab0-8f8e-e8afc72a2490 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:34.689304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755546-a5da-4ab0-8f8e-e8afc72a2490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:34.708345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-03755546-a5da-4ab0-8f8e-e8afc72a2490 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:34.709526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-03755546-a5da-4ab0-8f8e-e8afc72a2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:34.725393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:34.767445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1309/2584] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:34.777108 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:34.778664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:34.834944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23cb98-4ead-45e9-a204-8b888e238a9f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:34.838559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7f8bd-5af9-434c-a9f5-a3d27e2df4aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:34.839159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f8bd-5af9-434c-a9f5-a3d27e2df4aa service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:34.839443 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f8bd-5af9-434c-a9f5-a3d27e2df4aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:34.839749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7f8bd-5af9-434c-a9f5-a3d27e2df4aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:34.848610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7f8bd-5af9-434c-a9f5-a3d27e2df4aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:34.850575 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7f8bd-5af9-434c-a9f5-a3d27e2df4aa service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:34.859749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1276/2585] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:35.122946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03755546-a5da-4ab0-8f8e-e8afc72a2490 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.124402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-03755546-a5da-4ab0-8f8e-e8afc72a2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:35.137791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03755546-a5da-4ab0-8f8e-e8afc72a2490 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.142947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.143851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.144155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.144575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] PATH_INFO: `/v3/projects/a1d430f404414933994b562fa2cd89d9` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.145755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d430f404414933994b562fa2cd89d9)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.147762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.195001 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d430f404414933994b562fa2cd89d9', 'request_id': 'req-1618472e-cec4-41d1-9fa6-5ee035728920'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:35.200485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d430f404414933994b562fa2cd89d9', 'request_id': 'req-1618472e-cec4-41d1-9fa6-5ee035728920'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:35.206827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d430f404414933994b562fa2cd89d9', 'request_id': 'req-1618472e-cec4-41d1-9fa6-5ee035728920'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:35.219520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] The token cache is being invalidate because project a1d430f404414933994b562fa2cd89d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:35.219807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:35.220423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-1618472e-cec4-41d1-9fa6-5ee035728920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:35.221920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1310/2586] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:35 2022] DELETE /identity/v3/projects/a1d430f404414933994b562fa2cd89d9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:35.227490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b016-4bc5-48d7-94a9-5a529e28cc1d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.227779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b016-4bc5-48d7-94a9-5a529e28cc1d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.228055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b016-4bc5-48d7-94a9-5a529e28cc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.247159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-43f0b016-4bc5-48d7-94a9-5a529e28cc1d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:35.248355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-43f0b016-4bc5-48d7-94a9-5a529e28cc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:35.310727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1277/2587] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:35.318244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fcc61-88ae-44ed-a1f6-4a415cc3df2e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.318523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fcc61-88ae-44ed-a1f6-4a415cc3df2e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.318790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fcc61-88ae-44ed-a1f6-4a415cc3df2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.342066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c34fcc61-88ae-44ed-a1f6-4a415cc3df2e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:35.343243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c34fcc61-88ae-44ed-a1f6-4a415cc3df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:35.351795 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1311/2588] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:35.356192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0b016-4bc5-48d7-94a9-5a529e28cc1d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.365868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0b016-4bc5-48d7-94a9-5a529e28cc1d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.375082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.375692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.375969 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.376237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.376874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:54:35.377174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.378644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fcc61-88ae-44ed-a1f6-4a415cc3df2e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.378828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.380150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c34fcc61-88ae-44ed-a1f6-4a415cc3df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:35.390690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1278/2589] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:54:35.396650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.406499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253def3-5ab8-485b-8a17-2131d70de274 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.411096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be010b-487a-4aac-94ad-2e7d621e082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.412279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be010b-487a-4aac-94ad-2e7d621e082f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.412563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be010b-487a-4aac-94ad-2e7d621e082f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.412840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be010b-487a-4aac-94ad-2e7d621e082f admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.413466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be010b-487a-4aac-94ad-2e7d621e082f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.415427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be010b-487a-4aac-94ad-2e7d621e082f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.441440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fcc61-88ae-44ed-a1f6-4a415cc3df2e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.445333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.446075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.446363 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.446633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.447103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1279/2590] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:35 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:35.448598 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:35.451143 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be010b-487a-4aac-94ad-2e7d621e082f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.461916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.463367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.473043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1312/2591] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:54:35.489999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:35.514749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be010b-487a-4aac-94ad-2e7d621e082f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.520256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ae21f-5150-4e56-8bcf-13792f9b138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.520440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ae21f-5150-4e56-8bcf-13792f9b138b admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.521252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ae21f-5150-4e56-8bcf-13792f9b138b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.521526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ae21f-5150-4e56-8bcf-13792f9b138b admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.522558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ae21f-5150-4e56-8bcf-13792f9b138b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.524130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ae21f-5150-4e56-8bcf-13792f9b138b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.546457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1280/2592] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:35 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:54:35.550858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.560971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f691b0-ad4c-463d-88fb-c123d94c0b13 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.565960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dd2ff-e8e0-4d96-b494-1985b315cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.566583 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dd2ff-e8e0-4d96-b494-1985b315cb75 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.566947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dd2ff-e8e0-4d96-b494-1985b315cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.567336 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dd2ff-e8e0-4d96-b494-1985b315cb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.568485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dd2ff-e8e0-4d96-b494-1985b315cb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.570194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548dd2ff-e8e0-4d96-b494-1985b315cb75 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.580914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1313/2593] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:35.585872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ae21f-5150-4e56-8bcf-13792f9b138b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.596495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ae21f-5150-4e56-8bcf-13792f9b138b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.601335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be0181-fb97-4b17-9fe4-a99a56739ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.602008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0181-fb97-4b17-9fe4-a99a56739ecd admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.602295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0181-fb97-4b17-9fe4-a99a56739ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.602570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be0181-fb97-4b17-9fe4-a99a56739ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.603222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be0181-fb97-4b17-9fe4-a99a56739ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.604850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be0181-fb97-4b17-9fe4-a99a56739ecd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.615731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1281/2594] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:35.620076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dd2ff-e8e0-4d96-b494-1985b315cb75 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.631109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dd2ff-e8e0-4d96-b494-1985b315cb75 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.636085 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.636767 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.637066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.637322 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] PATH_INFO: `/v3/projects/825d5bcf706a4e19b05daa2b17f48b60/users/14a6fe00a4004d6b94efd4a357733b14/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.654742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=825d5bcf706a4e19b05daa2b17f48b60, user_id=14a6fe00a4004d6b94efd4a357733b14, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.657527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.673036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1314/2595] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:35 2022] PUT /identity/v3/projects/825d5bcf706a4e19b05daa2b17f48b60/users/14a6fe00a4004d6b94efd4a357733b14/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:35.684815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444a97-2d07-482f-b828-63f4e9d5bee6 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.685105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444a97-2d07-482f-b828-63f4e9d5bee6 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.685379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444a97-2d07-482f-b828-63f4e9d5bee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.715900 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c4444a97-2d07-482f-b828-63f4e9d5bee6 None None] MFA Rules not processed for user `14a6fe00a4004d6b94efd4a357733b14`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:35.717138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c4444a97-2d07-482f-b828-63f4e9d5bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:35.793716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1282/2596] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:35.805264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:35.807096 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:35.816925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:35.865876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ead6d-40ac-44d0-a09e-f9e96200bff6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:35.869506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:35.870136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:35.870418 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:35.870689 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:35.878956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:35.880887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:35.889585 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1315/2597] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:38.849278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4444a97-2d07-482f-b828-63f4e9d5bee6 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:38.850977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c4444a97-2d07-482f-b828-63f4e9d5bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:38.904061 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:38.905560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:38.946469 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4444a97-2d07-482f-b828-63f4e9d5bee6 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:38.951911 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:38.952727 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:38.953010 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:38.953406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:38.955194 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:38.967491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:38.969085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:38.979724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1283/2598] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:54:38.984486 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91333a58-a8e1-4c92-970a-8785ba103f4f service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:38.988974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:38.989656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:38.989937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:38.990210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] PATH_INFO: `/v3/users/66f98af5c7194ce58dde8258e2ecf945` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:38.991342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f98af5c7194ce58dde8258e2ecf945)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:38.993295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:39.041289 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f98af5c7194ce58dde8258e2ecf945'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.041971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f98af5c7194ce58dde8258e2ecf945'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.048746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f98af5c7194ce58dde8258e2ecf945'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.049459 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f98af5c7194ce58dde8258e2ecf945'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.065077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f2f458be-d29c-4772-a06d-de247caac2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f98af5c7194ce58dde8258e2ecf945'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.077856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1316/2599] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:38 2022] DELETE /identity/v3/users/66f98af5c7194ce58dde8258e2ecf945 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:54:39.253988 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:39.265186 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caf5ae-ff5c-445e-a29a-3cdf5c8ecae2 service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:39.296237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:39.325976 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:39.326645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.326850 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.327189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] PATH_INFO: `/v3/projects/bbd4a4fc422b45ae94da28ac774906e8` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.328442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd4a4fc422b45ae94da28ac774906e8)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:39.330429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:39.375952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd4a4fc422b45ae94da28ac774906e8', 'request_id': 'req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.381882 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd4a4fc422b45ae94da28ac774906e8', 'request_id': 'req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.389891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd4a4fc422b45ae94da28ac774906e8', 'request_id': 'req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.401378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] The token cache is being invalidate because project bbd4a4fc422b45ae94da28ac774906e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:39.401702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.402321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-5c0f6a31-5d64-4dc7-b9f7-19dfedcf5955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:39.403774 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1284/2600] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:39 2022] DELETE /identity/v3/projects/bbd4a4fc422b45ae94da28ac774906e8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:54:39.408891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd18e2-9622-4d45-94ba-7b939e61b47e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.409210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd18e2-9622-4d45-94ba-7b939e61b47e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.409487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd18e2-9622-4d45-94ba-7b939e61b47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.429314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-22bd18e2-9622-4d45-94ba-7b939e61b47e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:39.430550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-22bd18e2-9622-4d45-94ba-7b939e61b47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:39.455091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:39.491102 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1317/2601] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:39.498997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78984-61e2-4c4c-a20d-cedec77d3558 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.499282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78984-61e2-4c4c-a20d-cedec77d3558 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.499556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db78984-61e2-4c4c-a20d-cedec77d3558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.519558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8db78984-61e2-4c4c-a20d-cedec77d3558 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:39.521338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8db78984-61e2-4c4c-a20d-cedec77d3558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:39.529209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1285/2602] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:39.533407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd18e2-9622-4d45-94ba-7b939e61b47e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:39.542920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd18e2-9622-4d45-94ba-7b939e61b47e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:39.547441 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:39.548032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.548315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.548586 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.549225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:54:39.549530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:39.551154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:39.562474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1318/2603] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:54:39.566475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78984-61e2-4c4c-a20d-cedec77d3558 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:39.576043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db78984-61e2-4c4c-a20d-cedec77d3558 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:39.580650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c340123-a327-4441-9657-2ed604ec6a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:39.581237 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c340123-a327-4441-9657-2ed604ec6a79 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.581516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c340123-a327-4441-9657-2ed604ec6a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.581824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c340123-a327-4441-9657-2ed604ec6a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.582442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c340123-a327-4441-9657-2ed604ec6a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:39.584959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c340123-a327-4441-9657-2ed604ec6a79 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:39.611105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1286/2604] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:39 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:39.615078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:39.624842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a057d9b-62d4-4a46-b8c2-8737f3964aac admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:39.679979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc6f4a-4df5-44cd-8e33-2d091afea8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:39.680582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc6f4a-4df5-44cd-8e33-2d091afea8fc admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.680861 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc6f4a-4df5-44cd-8e33-2d091afea8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.681131 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc6f4a-4df5-44cd-8e33-2d091afea8fc admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.681800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc6f4a-4df5-44cd-8e33-2d091afea8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:39.683721 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc6f4a-4df5-44cd-8e33-2d091afea8fc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:39.704593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1319/2605] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:39 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:39.708672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c340123-a327-4441-9657-2ed604ec6a79 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:39.718775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c340123-a327-4441-9657-2ed604ec6a79 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:39.723382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e56b74-8b5c-4ec5-b47e-19be81390884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:39.724008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e56b74-8b5c-4ec5-b47e-19be81390884 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.724286 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e56b74-8b5c-4ec5-b47e-19be81390884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.724556 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e56b74-8b5c-4ec5-b47e-19be81390884 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.725185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e56b74-8b5c-4ec5-b47e-19be81390884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:39.726846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e56b74-8b5c-4ec5-b47e-19be81390884 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:39.736497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1287/2606] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:39.740765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc6f4a-4df5-44cd-8e33-2d091afea8fc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:39.750297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc6f4a-4df5-44cd-8e33-2d091afea8fc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:39.755811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35396f6-2828-4461-930b-5c8a29751264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:39.756404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35396f6-2828-4461-930b-5c8a29751264 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.756688 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35396f6-2828-4461-930b-5c8a29751264 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.756961 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35396f6-2828-4461-930b-5c8a29751264 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.757611 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35396f6-2828-4461-930b-5c8a29751264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:39.759219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35396f6-2828-4461-930b-5c8a29751264 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:39.770013 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1320/2607] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:39.773863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e56b74-8b5c-4ec5-b47e-19be81390884 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:39.783716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e56b74-8b5c-4ec5-b47e-19be81390884 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:39.788490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:39.789159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.789440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.789758 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] PATH_INFO: `/v3/projects/e3a21889132440aa95ad9eaae19e767a/users/533e403b03ed4d679553d770bc1e7ca8/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.804753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a21889132440aa95ad9eaae19e767a, user_id=533e403b03ed4d679553d770bc1e7ca8, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:39.807463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:39.821530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1288/2608] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:39 2022] PUT /identity/v3/projects/e3a21889132440aa95ad9eaae19e767a/users/533e403b03ed4d679553d770bc1e7ca8/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:39.833070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f88d-d2d9-4535-9ea7-2507b4f3195c None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:39.833500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f88d-d2d9-4535-9ea7-2507b4f3195c None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:39.833946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9f88d-d2d9-4535-9ea7-2507b4f3195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:39.861875 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e0e9f88d-d2d9-4535-9ea7-2507b4f3195c None None] MFA Rules not processed for user `533e403b03ed4d679553d770bc1e7ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:39.863117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e0e9f88d-d2d9-4535-9ea7-2507b4f3195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:39.934943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1321/2609] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:39.946499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:39.948262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:40.008261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:40.027806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268047a-c003-4a01-a0e8-5957597248c5 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:40.034133 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c11975-7c20-4ee2-a7d9-c8bc5dfdfb27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:40.034750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11975-7c20-4ee2-a7d9-c8bc5dfdfb27 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:40.035032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11975-7c20-4ee2-a7d9-c8bc5dfdfb27 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:40.035310 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11975-7c20-4ee2-a7d9-c8bc5dfdfb27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:40.043925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c11975-7c20-4ee2-a7d9-c8bc5dfdfb27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:40.045561 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c11975-7c20-4ee2-a7d9-c8bc5dfdfb27 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:40.055103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1289/2610] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:40.956310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f88d-d2d9-4535-9ea7-2507b4f3195c None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:40.957733 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e0e9f88d-d2d9-4535-9ea7-2507b4f3195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:40.984607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:41.022078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9f88d-d2d9-4535-9ea7-2507b4f3195c None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:41.026497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:41.027121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:41.027404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:41.027709 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] PATH_INFO: `/v3/users/14a6fe00a4004d6b94efd4a357733b14` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:41.028830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a6fe00a4004d6b94efd4a357733b14)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:41.030773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:41.076119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a6fe00a4004d6b94efd4a357733b14'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.076846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a6fe00a4004d6b94efd4a357733b14'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.084175 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a6fe00a4004d6b94efd4a357733b14'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.084809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a6fe00a4004d6b94efd4a357733b14'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.096257 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a6fe00a4004d6b94efd4a357733b14'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.107831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1322/2611] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:40 2022] DELETE /identity/v3/users/14a6fe00a4004d6b94efd4a357733b14 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:41.112506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b795d-7009-4872-aca7-194299bb0b87 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:41.113103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b795d-7009-4872-aca7-194299bb0b87 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:41.113103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b795d-7009-4872-aca7-194299bb0b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:41.132328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-442b795d-7009-4872-aca7-194299bb0b87 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:41.133521 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-442b795d-7009-4872-aca7-194299bb0b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:41.194501 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1290/2612] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:41.204078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:41.205456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:41.263224 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1072f-d7bd-480b-b94e-d8e053db85f9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:41.266978 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:41.267577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:41.267857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:41.268419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:41.277815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:41.279244 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:41.289392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1323/2613] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:41.557775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b795d-7009-4872-aca7-194299bb0b87 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:41.559709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-442b795d-7009-4872-aca7-194299bb0b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:41.574457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b795d-7009-4872-aca7-194299bb0b87 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:41.579399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:41.580374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:41.580658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:41.580935 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] PATH_INFO: `/v3/projects/825d5bcf706a4e19b05daa2b17f48b60` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:41.582320 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=825d5bcf706a4e19b05daa2b17f48b60)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:41.584743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:41.638159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825d5bcf706a4e19b05daa2b17f48b60', 'request_id': 'req-712f3153-46d6-4bcb-a098-8513a0325971'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.645534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825d5bcf706a4e19b05daa2b17f48b60', 'request_id': 'req-712f3153-46d6-4bcb-a098-8513a0325971'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.655236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825d5bcf706a4e19b05daa2b17f48b60', 'request_id': 'req-712f3153-46d6-4bcb-a098-8513a0325971'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.667567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] The token cache is being invalidate because project 825d5bcf706a4e19b05daa2b17f48b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:41.667868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.668507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-712f3153-46d6-4bcb-a098-8513a0325971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:41.670554 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1291/2614] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:41 2022] DELETE /identity/v3/projects/825d5bcf706a4e19b05daa2b17f48b60 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:42.738310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:42.738310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:42.751630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739954c2-ca17-46cc-851a-6671d0c96c3f service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:42.795581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:42.810753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:42.811373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:42.811652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:42.811952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] PATH_INFO: `/v3/users/533e403b03ed4d679553d770bc1e7ca8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:42.813145 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=533e403b03ed4d679553d770bc1e7ca8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:42.815132 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:42.858628 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533e403b03ed4d679553d770bc1e7ca8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:42.859270 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533e403b03ed4d679553d770bc1e7ca8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:42.866444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533e403b03ed4d679553d770bc1e7ca8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:42.867072 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533e403b03ed4d679553d770bc1e7ca8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:42.879114 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533e403b03ed4d679553d770bc1e7ca8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:42.892448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1324/2615] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:42 2022] DELETE /identity/v3/users/533e403b03ed4d679553d770bc1e7ca8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:42.897318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8392-7a96-40e9-a0b3-21118db7da9d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:42.897845 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8392-7a96-40e9-a0b3-21118db7da9d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:42.897958 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8392-7a96-40e9-a0b3-21118db7da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:42.916292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-877c8392-7a96-40e9-a0b3-21118db7da9d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:42.917509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-877c8392-7a96-40e9-a0b3-21118db7da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:42.975187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1292/2616] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:42.984828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:42.986240 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:43.043716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81468f-d4b3-40b0-92ac-16f03f3485dd admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:43.047223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d3b4d-6212-4461-81ba-240aa3be8720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:43.047814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3b4d-6212-4461-81ba-240aa3be8720 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.048094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3b4d-6212-4461-81ba-240aa3be8720 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.048358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d3b4d-6212-4461-81ba-240aa3be8720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.057660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3b4d-6212-4461-81ba-240aa3be8720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:43.059073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d3b4d-6212-4461-81ba-240aa3be8720 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:43.068121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1325/2617] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:43.330150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c8392-7a96-40e9-a0b3-21118db7da9d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:43.331610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-877c8392-7a96-40e9-a0b3-21118db7da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:43.345288 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c8392-7a96-40e9-a0b3-21118db7da9d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:43.350629 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:43.351373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.351667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.351937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] PATH_INFO: `/v3/projects/e3a21889132440aa95ad9eaae19e767a` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.353267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a21889132440aa95ad9eaae19e767a)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:43.355281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:43.357655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:43.402388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a21889132440aa95ad9eaae19e767a', 'request_id': 'req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:43.407731 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a21889132440aa95ad9eaae19e767a', 'request_id': 'req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:43.416771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a21889132440aa95ad9eaae19e767a', 'request_id': 'req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:43.428780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] The token cache is being invalidate because project e3a21889132440aa95ad9eaae19e767a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:43.429076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:43.429748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-e460b8ee-c57b-4abd-a12b-8a2ec5fe9f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:43.431251 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1293/2618] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:43 2022] DELETE /identity/v3/projects/e3a21889132440aa95ad9eaae19e767a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:43.436208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f094f44-732a-482d-952b-999a2205d0f4 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.436496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f094f44-732a-482d-952b-999a2205d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.436796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f094f44-732a-482d-952b-999a2205d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.455784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3f094f44-732a-482d-952b-999a2205d0f4 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:43.456969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3f094f44-732a-482d-952b-999a2205d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:43.514675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1326/2619] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:43.523219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2a35-5f19-44e4-9f24-2238ce49509b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.523500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2a35-5f19-44e4-9f24-2238ce49509b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.523768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2a35-5f19-44e4-9f24-2238ce49509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.543864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-411c2a35-5f19-44e4-9f24-2238ce49509b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:43.545061 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-411c2a35-5f19-44e4-9f24-2238ce49509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:43.553323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1294/2620] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:43.557484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f094f44-732a-482d-952b-999a2205d0f4 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:43.567036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f094f44-732a-482d-952b-999a2205d0f4 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:43.572128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:43.572716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.573000 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.573268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.573946 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:54:43.574246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:43.575824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:43.578217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:43.588625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1327/2621] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:54:43.592645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c2a35-5f19-44e4-9f24-2238ce49509b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:43.601676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c2a35-5f19-44e4-9f24-2238ce49509b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:43.606279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65cd4a-14d7-4ef8-b7ed-1f53ed90d812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:43.606871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65cd4a-14d7-4ef8-b7ed-1f53ed90d812 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.607159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65cd4a-14d7-4ef8-b7ed-1f53ed90d812 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.607432 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65cd4a-14d7-4ef8-b7ed-1f53ed90d812 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.608067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65cd4a-14d7-4ef8-b7ed-1f53ed90d812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:43.609998 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65cd4a-14d7-4ef8-b7ed-1f53ed90d812 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:43.636759 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1295/2622] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:43 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:43.640799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:43.651284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e9e5d-1f0b-4bbf-87de-6400687d999e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:43.705405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56f300-da5d-4551-8ae0-6df2e28232ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:43.706037 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56f300-da5d-4551-8ae0-6df2e28232ce admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.706332 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56f300-da5d-4551-8ae0-6df2e28232ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.706593 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56f300-da5d-4551-8ae0-6df2e28232ce admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.707207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56f300-da5d-4551-8ae0-6df2e28232ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:43.709677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56f300-da5d-4551-8ae0-6df2e28232ce admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:43.731110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1328/2623] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:43 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:43.735203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65cd4a-14d7-4ef8-b7ed-1f53ed90d812 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:43.745502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65cd4a-14d7-4ef8-b7ed-1f53ed90d812 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:43.750115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e076-0ea5-41f9-bd4b-1b89bf57d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:43.750718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e076-0ea5-41f9-bd4b-1b89bf57d5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.751023 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e076-0ea5-41f9-bd4b-1b89bf57d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.751294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6e076-0ea5-41f9-bd4b-1b89bf57d5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.751962 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e076-0ea5-41f9-bd4b-1b89bf57d5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:43.753682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6e076-0ea5-41f9-bd4b-1b89bf57d5d3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:43.764280 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1296/2624] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:43.770755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56f300-da5d-4551-8ae0-6df2e28232ce admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:43.780971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56f300-da5d-4551-8ae0-6df2e28232ce admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:43.785802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e440-6a55-445d-98f3-3afcdd99d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:43.786398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e440-6a55-445d-98f3-3afcdd99d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.786675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e440-6a55-445d-98f3-3afcdd99d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.787027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e440-6a55-445d-98f3-3afcdd99d2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.788168 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251e440-6a55-445d-98f3-3afcdd99d2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:43.789768 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251e440-6a55-445d-98f3-3afcdd99d2bd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:43.800210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1329/2625] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:43.804458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e076-0ea5-41f9-bd4b-1b89bf57d5d3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:43.814284 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6e076-0ea5-41f9-bd4b-1b89bf57d5d3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:43.819430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:43.820070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.820353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.820632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] PATH_INFO: `/v3/projects/0183b41ba7c2430b8388955bfebb6967/users/c232661c70734cdb964410428d542d46/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.835673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0183b41ba7c2430b8388955bfebb6967, user_id=c232661c70734cdb964410428d542d46, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:43.838397 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:43.850888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1297/2626] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:43 2022] PUT /identity/v3/projects/0183b41ba7c2430b8388955bfebb6967/users/c232661c70734cdb964410428d542d46/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:43.861052 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca799-4ffb-4221-bf75-6c60a659346b None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:43.861340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca799-4ffb-4221-bf75-6c60a659346b None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:43.861635 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ca799-4ffb-4221-bf75-6c60a659346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:43.889615 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-938ca799-4ffb-4221-bf75-6c60a659346b None None] MFA Rules not processed for user `c232661c70734cdb964410428d542d46`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:43.890836 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-938ca799-4ffb-4221-bf75-6c60a659346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:43.952541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1330/2627] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:43.963769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:43.965502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:44.022567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eacba-0599-4536-a286-929c8b48d8ef admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:44.026107 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb34a56-eb09-45fd-be9e-e0c105839bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:44.026705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb34a56-eb09-45fd-be9e-e0c105839bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:44.026985 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb34a56-eb09-45fd-be9e-e0c105839bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:44.027254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb34a56-eb09-45fd-be9e-e0c105839bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:44.035285 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb34a56-eb09-45fd-be9e-e0c105839bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:44.036710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb34a56-eb09-45fd-be9e-e0c105839bf9 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:44.045250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1298/2628] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:52.365283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ca799-4ffb-4221-bf75-6c60a659346b None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:52.428371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ca799-4ffb-4221-bf75-6c60a659346b None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:52.432868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:52.433498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:52.433809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:52.434083 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] PATH_INFO: `/v3/users/c232661c70734cdb964410428d542d46` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:52.435195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c232661c70734cdb964410428d542d46)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:52.437116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:52.441867 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:52.484012 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c232661c70734cdb964410428d542d46'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:52.484662 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c232661c70734cdb964410428d542d46'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:52.491523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c232661c70734cdb964410428d542d46'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:52.492191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c232661c70734cdb964410428d542d46'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:52.503880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c232661c70734cdb964410428d542d46'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:52.517205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1331/2629] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:52 2022] DELETE /identity/v3/users/c232661c70734cdb964410428d542d46 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:52.522044 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ab66-2cf5-46bc-9a1a-133022f94595 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:52.522513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ab66-2cf5-46bc-9a1a-133022f94595 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:52.522641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373ab66-2cf5-46bc-9a1a-133022f94595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:52.542487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a373ab66-2cf5-46bc-9a1a-133022f94595 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:52.543687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a373ab66-2cf5-46bc-9a1a-133022f94595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:52.568669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:52.603473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1299/2630] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:52.613154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:52.614605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:52.670088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13309ac6-5c34-4571-9620-aa9434b3063d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:52.673748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f8e85-a7bc-4370-8eb9-ed445ed5d73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:52.674349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8e85-a7bc-4370-8eb9-ed445ed5d73f service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:52.674634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8e85-a7bc-4370-8eb9-ed445ed5d73f service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:52.674909 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8e85-a7bc-4370-8eb9-ed445ed5d73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:52.683705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f8e85-a7bc-4370-8eb9-ed445ed5d73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:52.685124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f8e85-a7bc-4370-8eb9-ed445ed5d73f service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:52.699403 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1332/2631] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:52.963723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373ab66-2cf5-46bc-9a1a-133022f94595 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:52.965156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a373ab66-2cf5-46bc-9a1a-133022f94595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:52.979178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373ab66-2cf5-46bc-9a1a-133022f94595 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:52.983742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:52.984370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:52.984647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:52.984914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] PATH_INFO: `/v3/projects/0183b41ba7c2430b8388955bfebb6967` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:52.986040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0183b41ba7c2430b8388955bfebb6967)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:52.987941 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:53.033797 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0183b41ba7c2430b8388955bfebb6967', 'request_id': 'req-6fa86d27-69d4-4c80-bcb1-8ba982137588'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:53.039248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0183b41ba7c2430b8388955bfebb6967', 'request_id': 'req-6fa86d27-69d4-4c80-bcb1-8ba982137588'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:53.046566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0183b41ba7c2430b8388955bfebb6967', 'request_id': 'req-6fa86d27-69d4-4c80-bcb1-8ba982137588'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:53.057529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] The token cache is being invalidate because project 0183b41ba7c2430b8388955bfebb6967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:53.057856 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:53.058490 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6fa86d27-69d4-4c80-bcb1-8ba982137588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:53.060038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1300/2632] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:52 2022] DELETE /identity/v3/projects/0183b41ba7c2430b8388955bfebb6967 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:53.064872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee33c2-7a5a-4394-95e8-7d063b733caf None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.065263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee33c2-7a5a-4394-95e8-7d063b733caf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.065626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee33c2-7a5a-4394-95e8-7d063b733caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.085164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-7aee33c2-7a5a-4394-95e8-7d063b733caf None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:53.087045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7aee33c2-7a5a-4394-95e8-7d063b733caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:53.152007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1333/2633] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:53.160590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877743f-25c0-4b49-9b73-785012f3f22a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.160881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877743f-25c0-4b49-9b73-785012f3f22a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.161157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877743f-25c0-4b49-9b73-785012f3f22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.181723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-0877743f-25c0-4b49-9b73-785012f3f22a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:53.182919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0877743f-25c0-4b49-9b73-785012f3f22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:53.190674 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1301/2634] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:54:53.195110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee33c2-7a5a-4394-95e8-7d063b733caf None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:53.205140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee33c2-7a5a-4394-95e8-7d063b733caf None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:53.209871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:53.210466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.210749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.211025 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.211668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:54:53.211975 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:53.213567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:53.224877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1334/2635] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:54:53.228994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877743f-25c0-4b49-9b73-785012f3f22a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:53.238097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877743f-25c0-4b49-9b73-785012f3f22a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:53.243217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3be358-fb0c-4202-8ce0-0d7c8c35986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:53.243805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be358-fb0c-4202-8ce0-0d7c8c35986c admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.244083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be358-fb0c-4202-8ce0-0d7c8c35986c admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.244353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be358-fb0c-4202-8ce0-0d7c8c35986c admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.244999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3be358-fb0c-4202-8ce0-0d7c8c35986c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:53.246918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3be358-fb0c-4202-8ce0-0d7c8c35986c admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:53.273424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1302/2636] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:53 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:53.277454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:53.287265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068747a-3904-4924-9dd0-05cb4cf9f838 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:53.295801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:53.344159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636a51f-fa27-4542-b5c8-c01c7ae05bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:53.344755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636a51f-fa27-4542-b5c8-c01c7ae05bcb admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.345034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636a51f-fa27-4542-b5c8-c01c7ae05bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.345311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636a51f-fa27-4542-b5c8-c01c7ae05bcb admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.346238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636a51f-fa27-4542-b5c8-c01c7ae05bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:53.348207 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636a51f-fa27-4542-b5c8-c01c7ae05bcb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:53.369612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1335/2637] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:53 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:54:53.373984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3be358-fb0c-4202-8ce0-0d7c8c35986c admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:53.384726 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3be358-fb0c-4202-8ce0-0d7c8c35986c admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:53.389300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533e2f-e0b7-411c-8493-900f0bd5f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:53.389927 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533e2f-e0b7-411c-8493-900f0bd5f1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.390235 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533e2f-e0b7-411c-8493-900f0bd5f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.390506 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51533e2f-e0b7-411c-8493-900f0bd5f1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.391137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51533e2f-e0b7-411c-8493-900f0bd5f1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:53.392746 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51533e2f-e0b7-411c-8493-900f0bd5f1d6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:53.403216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1303/2638] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:53.406953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636a51f-fa27-4542-b5c8-c01c7ae05bcb admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:53.417977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636a51f-fa27-4542-b5c8-c01c7ae05bcb admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:53.423171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc72f4-d838-4edb-a496-57b00b415590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:53.423931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc72f4-d838-4edb-a496-57b00b415590 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.424273 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc72f4-d838-4edb-a496-57b00b415590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.424587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc72f4-d838-4edb-a496-57b00b415590 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.425340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc72f4-d838-4edb-a496-57b00b415590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:53.427479 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc72f4-d838-4edb-a496-57b00b415590 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:53.439088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1336/2639] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:53.443252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533e2f-e0b7-411c-8493-900f0bd5f1d6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:53.453616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51533e2f-e0b7-411c-8493-900f0bd5f1d6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:53.458146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:53.458790 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.459068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.459344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] PATH_INFO: `/v3/projects/32b0ffb925dc4c75954636dc236339ba/users/c45a58f74e814cbc8cf4a6e1cee53c90/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.473315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b0ffb925dc4c75954636dc236339ba, user_id=c45a58f74e814cbc8cf4a6e1cee53c90, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:53.476481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:53.489354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1304/2640] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:53 2022] PUT /identity/v3/projects/32b0ffb925dc4c75954636dc236339ba/users/c45a58f74e814cbc8cf4a6e1cee53c90/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:53.500245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df4f71-1a74-4e3b-b7cd-ebc90e679937 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.500537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df4f71-1a74-4e3b-b7cd-ebc90e679937 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.500815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df4f71-1a74-4e3b-b7cd-ebc90e679937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.528059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d6df4f71-1a74-4e3b-b7cd-ebc90e679937 None None] MFA Rules not processed for user `c45a58f74e814cbc8cf4a6e1cee53c90`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:53.529254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d6df4f71-1a74-4e3b-b7cd-ebc90e679937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:53.592571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1337/2641] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:53.603981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:53.605715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:53.655646 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:53.678355 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22d523-4668-4628-94c1-a570106bcbef admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:53.684497 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a5bf-1d12-460d-859d-332b67e2cdbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:53.685131 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a5bf-1d12-460d-859d-332b67e2cdbe service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.685417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a5bf-1d12-460d-859d-332b67e2cdbe service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.685724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a5bf-1d12-460d-859d-332b67e2cdbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.693441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8a5bf-1d12-460d-859d-332b67e2cdbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:53.695090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8a5bf-1d12-460d-859d-332b67e2cdbe service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:53.703648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1305/2642] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:53.909103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df4f71-1a74-4e3b-b7cd-ebc90e679937 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:53.969400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df4f71-1a74-4e3b-b7cd-ebc90e679937 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:53.973926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:53.974558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:53.974853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:53.975112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] PATH_INFO: `/v3/users/c45a58f74e814cbc8cf4a6e1cee53c90` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:53.976824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45a58f74e814cbc8cf4a6e1cee53c90)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:53.978779 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:54.000253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:54.026083 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45a58f74e814cbc8cf4a6e1cee53c90'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.026723 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45a58f74e814cbc8cf4a6e1cee53c90'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.033428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45a58f74e814cbc8cf4a6e1cee53c90'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.034077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45a58f74e814cbc8cf4a6e1cee53c90'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.046184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45a58f74e814cbc8cf4a6e1cee53c90'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.058813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1338/2643] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:54:53 2022] DELETE /identity/v3/users/c45a58f74e814cbc8cf4a6e1cee53c90 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:54.063335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f83d-5f8b-4189-abeb-dc1f9baf0c96 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.063800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f83d-5f8b-4189-abeb-dc1f9baf0c96 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.064109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f83d-5f8b-4189-abeb-dc1f9baf0c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.082801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-01b9f83d-5f8b-4189-abeb-dc1f9baf0c96 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:54.083999 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-01b9f83d-5f8b-4189-abeb-dc1f9baf0c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:54.141437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1306/2644] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:54.151852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:54.153251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:54.209298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a44dfc-614e-4ffa-a544-6f82a67aa5f2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:54.213430 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d168b01-3ada-4694-abb6-21a00c7dfd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:54.214071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168b01-3ada-4694-abb6-21a00c7dfd33 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.214357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168b01-3ada-4694-abb6-21a00c7dfd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.214632 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168b01-3ada-4694-abb6-21a00c7dfd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.223412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168b01-3ada-4694-abb6-21a00c7dfd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:54.224823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168b01-3ada-4694-abb6-21a00c7dfd33 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:54.234757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1339/2645] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:54.497185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9f83d-5f8b-4189-abeb-dc1f9baf0c96 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:54.498741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-01b9f83d-5f8b-4189-abeb-dc1f9baf0c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:54.511421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9f83d-5f8b-4189-abeb-dc1f9baf0c96 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:54.516238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:54.516873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.517153 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.517429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] PATH_INFO: `/v3/projects/32b0ffb925dc4c75954636dc236339ba` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.518878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b0ffb925dc4c75954636dc236339ba)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:54.520852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:54.566643 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b0ffb925dc4c75954636dc236339ba', 'request_id': 'req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.572906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b0ffb925dc4c75954636dc236339ba', 'request_id': 'req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.580146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b0ffb925dc4c75954636dc236339ba', 'request_id': 'req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.591722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] The token cache is being invalidate because project 32b0ffb925dc4c75954636dc236339ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:54:54.592018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.592668 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-ff57eb86-3a9c-45f0-bf7e-20cc392deb3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:54:54.594173 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1307/2646] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:54:54 2022] DELETE /identity/v3/projects/32b0ffb925dc4c75954636dc236339ba => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:54.598955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d31fd-629a-4b67-a6fd-38961cefc992 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.599414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d31fd-629a-4b67-a6fd-38961cefc992 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.599529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d31fd-629a-4b67-a6fd-38961cefc992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.618886 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ea0d31fd-629a-4b67-a6fd-38961cefc992 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:54.620062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ea0d31fd-629a-4b67-a6fd-38961cefc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:54.677122 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1340/2647] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:54.685475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddd081-a42c-40b9-b985-a384ce086140 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.687036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddd081-a42c-40b9-b985-a384ce086140 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.687036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddd081-a42c-40b9-b985-a384ce086140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.706274 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-61ddd081-a42c-40b9-b985-a384ce086140 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:54.707462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-61ddd081-a42c-40b9-b985-a384ce086140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:54.715245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1308/2648] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:54.719431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d31fd-629a-4b67-a6fd-38961cefc992 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:54.728927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d31fd-629a-4b67-a6fd-38961cefc992 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:54.733457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:54.734097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.734382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.734655 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.735302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:54:54.735607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:54.737190 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:54.749017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1341/2649] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:54:54.753035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddd081-a42c-40b9-b985-a384ce086140 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:54.763207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddd081-a42c-40b9-b985-a384ce086140 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:54.775021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a13cb-12fd-4e8a-9638-dde869754c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:54.775898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a13cb-12fd-4e8a-9638-dde869754c64 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.776187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a13cb-12fd-4e8a-9638-dde869754c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.776456 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a13cb-12fd-4e8a-9638-dde869754c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.777114 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a13cb-12fd-4e8a-9638-dde869754c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:54.779040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a13cb-12fd-4e8a-9638-dde869754c64 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:54.806071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1309/2650] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:54 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:54.810216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:54.819987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa218bbf-a765-4749-b8af-b4739b7d4728 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:54.848170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:54.878698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06c87-0b26-44ab-a99a-245867693257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:54.879303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06c87-0b26-44ab-a99a-245867693257 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.879584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06c87-0b26-44ab-a99a-245867693257 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.879857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06c87-0b26-44ab-a99a-245867693257 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.880499 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b06c87-0b26-44ab-a99a-245867693257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:54.882519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b06c87-0b26-44ab-a99a-245867693257 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:54.903805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1342/2651] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:54 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:54.908021 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a13cb-12fd-4e8a-9638-dde869754c64 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:54.918716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a13cb-12fd-4e8a-9638-dde869754c64 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:54.923326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb98a6-495f-4a48-be2c-0dedcddcb2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:54.923954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb98a6-495f-4a48-be2c-0dedcddcb2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.924240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb98a6-495f-4a48-be2c-0dedcddcb2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.924516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb98a6-495f-4a48-be2c-0dedcddcb2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.925174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb98a6-495f-4a48-be2c-0dedcddcb2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:54.926781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb98a6-495f-4a48-be2c-0dedcddcb2c1 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:54.936563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1310/2652] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:54.940279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06c87-0b26-44ab-a99a-245867693257 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:54.950213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06c87-0b26-44ab-a99a-245867693257 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:54.954739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9d094-5cef-4f29-b5c9-1049ce7716b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:54.955325 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d094-5cef-4f29-b5c9-1049ce7716b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.955606 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d094-5cef-4f29-b5c9-1049ce7716b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.955876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9d094-5cef-4f29-b5c9-1049ce7716b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:54.956502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d094-5cef-4f29-b5c9-1049ce7716b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:54.958103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9d094-5cef-4f29-b5c9-1049ce7716b4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:54.968815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1343/2653] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:54:54.972855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb98a6-495f-4a48-be2c-0dedcddcb2c1 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:54.983089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb98a6-495f-4a48-be2c-0dedcddcb2c1 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:54.987697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bf5ea-4ffe-4ee4-84ce-f7160e8368d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:54.988343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf5ea-4ffe-4ee4-84ce-f7160e8368d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:54.988623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf5ea-4ffe-4ee4-84ce-f7160e8368d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:54.988899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf5ea-4ffe-4ee4-84ce-f7160e8368d2 admin admin] PATH_INFO: `/v3/projects/ae293711ca504073ba25bd4eab399be4/users/840760fb92c648cfbae73d9d5ca10544/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.003267 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bf5ea-4ffe-4ee4-84ce-f7160e8368d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae293711ca504073ba25bd4eab399be4, user_id=840760fb92c648cfbae73d9d5ca10544, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.005905 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bf5ea-4ffe-4ee4-84ce-f7160e8368d2 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.009546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:55.021865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1311/2654] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:54 2022] PUT /identity/v3/projects/ae293711ca504073ba25bd4eab399be4/users/840760fb92c648cfbae73d9d5ca10544/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:54:55.033905 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3b70-ee98-418d-a4b4-4b5bb5efbad5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.034188 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3b70-ee98-418d-a4b4-4b5bb5efbad5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.034456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3b70-ee98-418d-a4b4-4b5bb5efbad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.061031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e8fa3b70-ee98-418d-a4b4-4b5bb5efbad5 None None] MFA Rules not processed for user `840760fb92c648cfbae73d9d5ca10544`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:55.062242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e8fa3b70-ee98-418d-a4b4-4b5bb5efbad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:55.126384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1344/2655] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:55.130853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bf5ea-4ffe-4ee4-84ce-f7160e8368d2 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:55.191101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bf5ea-4ffe-4ee4-84ce-f7160e8368d2 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:55.196318 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d01803-9f5a-4c21-b940-e4a01d896257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:55.196919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d01803-9f5a-4c21-b940-e4a01d896257 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.197228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d01803-9f5a-4c21-b940-e4a01d896257 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.197468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d01803-9f5a-4c21-b940-e4a01d896257 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.198120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d01803-9f5a-4c21-b940-e4a01d896257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.200020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d01803-9f5a-4c21-b940-e4a01d896257 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.226344 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1312/2656] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:54:55 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:54:55.230358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3b70-ee98-418d-a4b4-4b5bb5efbad5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:55.240811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3b70-ee98-418d-a4b4-4b5bb5efbad5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:55.297780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a126464-4e84-43fb-b510-a4b287f2427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:55.298309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126464-4e84-43fb-b510-a4b287f2427a admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.298588 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126464-4e84-43fb-b510-a4b287f2427a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.298864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126464-4e84-43fb-b510-a4b287f2427a admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.299490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a126464-4e84-43fb-b510-a4b287f2427a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.301391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a126464-4e84-43fb-b510-a4b287f2427a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.322173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1345/2657] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:54:55 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:54:55.326300 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d01803-9f5a-4c21-b940-e4a01d896257 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:55.338039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d01803-9f5a-4c21-b940-e4a01d896257 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:55.342604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b266b7-71f6-4220-959f-9120049eb94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:55.343195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b266b7-71f6-4220-959f-9120049eb94e admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.343472 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b266b7-71f6-4220-959f-9120049eb94e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.343741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b266b7-71f6-4220-959f-9120049eb94e admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.344371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b266b7-71f6-4220-959f-9120049eb94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.346037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b266b7-71f6-4220-959f-9120049eb94e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.356835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1313/2658] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:54:55.360892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a126464-4e84-43fb-b510-a4b287f2427a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:55.371715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a126464-4e84-43fb-b510-a4b287f2427a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:55.376335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b2399-5992-4e63-ad4c-f641928b839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:55.376990 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b2399-5992-4e63-ad4c-f641928b839a admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.377270 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b2399-5992-4e63-ad4c-f641928b839a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.377546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b2399-5992-4e63-ad4c-f641928b839a admin admin] PATH_INFO: `/v3/projects/c1cd05c5da3c4699ae8c53b6fd2ad6ce/users/8b377d55fa1045758102f54db838bbc4/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.392917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b2399-5992-4e63-ad4c-f641928b839a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1cd05c5da3c4699ae8c53b6fd2ad6ce, user_id=8b377d55fa1045758102f54db838bbc4, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.395853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b2399-5992-4e63-ad4c-f641928b839a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.409164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1346/2659] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:55 2022] PUT /identity/v3/projects/c1cd05c5da3c4699ae8c53b6fd2ad6ce/users/8b377d55fa1045758102f54db838bbc4/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:55.413161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b266b7-71f6-4220-959f-9120049eb94e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:55.424091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b266b7-71f6-4220-959f-9120049eb94e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:55.480729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24555c03-228d-4c88-bf38-29f340a6198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:55.481343 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555c03-228d-4c88-bf38-29f340a6198b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.481651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555c03-228d-4c88-bf38-29f340a6198b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.481931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555c03-228d-4c88-bf38-29f340a6198b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.482569 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24555c03-228d-4c88-bf38-29f340a6198b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.484195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24555c03-228d-4c88-bf38-29f340a6198b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.494014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1314/2660] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:54:55.498333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b2399-5992-4e63-ad4c-f641928b839a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:55.504871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:55.508889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b2399-5992-4e63-ad4c-f641928b839a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:55.514755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:55.515407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.515687 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.515963 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] PATH_INFO: `/v3/projects/c1cd05c5da3c4699ae8c53b6fd2ad6ce/users/8b377d55fa1045758102f54db838bbc4/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.517919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1cd05c5da3c4699ae8c53b6fd2ad6ce, user_id=8b377d55fa1045758102f54db838bbc4, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.520834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.531503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1347/2661] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:54:55 2022] PUT /identity/v3/projects/c1cd05c5da3c4699ae8c53b6fd2ad6ce/users/8b377d55fa1045758102f54db838bbc4/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:54:55.542312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0756-c3a3-4722-bc2c-1ec4746bb7e4 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.542601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0756-c3a3-4722-bc2c-1ec4746bb7e4 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.542879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0756-c3a3-4722-bc2c-1ec4746bb7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.571018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b01e0756-c3a3-4722-bc2c-1ec4746bb7e4 None None] MFA Rules not processed for user `8b377d55fa1045758102f54db838bbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:54:55.572419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b01e0756-c3a3-4722-bc2c-1ec4746bb7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:55.626693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:54:55.645930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1315/2662] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:54:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:54:55.657845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:55.659535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:54:55.717715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ffc85-250f-42bb-9a21-b41b1f8f8ebc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:55.721340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6649ec7-6c24-4f01-aea9-09459205d72f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:55.721980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649ec7-6c24-4f01-aea9-09459205d72f service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.722258 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649ec7-6c24-4f01-aea9-09459205d72f service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.722531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649ec7-6c24-4f01-aea9-09459205d72f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.732216 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6649ec7-6c24-4f01-aea9-09459205d72f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.733661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6649ec7-6c24-4f01-aea9-09459205d72f service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.742846 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1348/2663] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:54:55.827714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e0756-c3a3-4722-bc2c-1ec4746bb7e4 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:54:55.837928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e0756-c3a3-4722-bc2c-1ec4746bb7e4 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:54:55.841511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e7adc-e90c-4452-ab91-9b595a1d28da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:54:55.842211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e7adc-e90c-4452-ab91-9b595a1d28da service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:54:55.842492 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e7adc-e90c-4452-ab91-9b595a1d28da service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:54:55.842764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e7adc-e90c-4452-ab91-9b595a1d28da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:54:55.899199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e7adc-e90c-4452-ab91-9b595a1d28da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:54:55.900895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e7adc-e90c-4452-ab91-9b595a1d28da service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:54:55.910504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1316/2664] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:54:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:00.581995 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6649ec7-6c24-4f01-aea9-09459205d72f service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:00.643279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6649ec7-6c24-4f01-aea9-09459205d72f service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:00.647865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:00.648487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:00.648770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:00.649045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] PATH_INFO: `/v3/users/840760fb92c648cfbae73d9d5ca10544` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:00.650176 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=840760fb92c648cfbae73d9d5ca10544)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:00.652108 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:00.697964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840760fb92c648cfbae73d9d5ca10544'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:00.698528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840760fb92c648cfbae73d9d5ca10544'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:00.705103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840760fb92c648cfbae73d9d5ca10544'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:00.705821 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840760fb92c648cfbae73d9d5ca10544'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:00.719120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840760fb92c648cfbae73d9d5ca10544'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:00.731634 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1349/2665] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:55:00 2022] DELETE /identity/v3/users/840760fb92c648cfbae73d9d5ca10544 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:00.736067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7c0e7-5783-4598-83d0-07bfd70b3e91 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:00.736551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7c0e7-5783-4598-83d0-07bfd70b3e91 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:00.736648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7c0e7-5783-4598-83d0-07bfd70b3e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:00.755416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-12e7c0e7-5783-4598-83d0-07bfd70b3e91 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:00.756603 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-12e7c0e7-5783-4598-83d0-07bfd70b3e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:00.815245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1317/2666] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:00.825404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:00.826830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:00.840716 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:00.883427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec47ae6-39f5-4891-99d0-feb3deaabe62 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:00.887082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b88eca-c843-4b48-9544-d231da4fd5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:00.887684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b88eca-c843-4b48-9544-d231da4fd5bb service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:00.887982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b88eca-c843-4b48-9544-d231da4fd5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:00.888235 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b88eca-c843-4b48-9544-d231da4fd5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:00.897302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b88eca-c843-4b48-9544-d231da4fd5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:00.898796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b88eca-c843-4b48-9544-d231da4fd5bb service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:00.908004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1350/2667] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:01.171335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7c0e7-5783-4598-83d0-07bfd70b3e91 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:01.172749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-12e7c0e7-5783-4598-83d0-07bfd70b3e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:01.187279 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7c0e7-5783-4598-83d0-07bfd70b3e91 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:01.191893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:01.192522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:01.192800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:01.193074 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] PATH_INFO: `/v3/projects/ae293711ca504073ba25bd4eab399be4` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:01.194207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae293711ca504073ba25bd4eab399be4)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:01.196162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:01.243232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae293711ca504073ba25bd4eab399be4', 'request_id': 'req-461cd7ab-3e91-406a-bce5-ccf445bd25ea'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.248647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae293711ca504073ba25bd4eab399be4', 'request_id': 'req-461cd7ab-3e91-406a-bce5-ccf445bd25ea'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.256086 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae293711ca504073ba25bd4eab399be4', 'request_id': 'req-461cd7ab-3e91-406a-bce5-ccf445bd25ea'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.267040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] The token cache is being invalidate because project ae293711ca504073ba25bd4eab399be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:55:01.267330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.268214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.269709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1318/2668] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:55:01 2022] DELETE /identity/v3/projects/ae293711ca504073ba25bd4eab399be4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:01.273834 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b88eca-c843-4b48-9544-d231da4fd5bb service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:01.283184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b88eca-c843-4b48-9544-d231da4fd5bb service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:01.338252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:01.338873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:01.339154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:01.339427 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] PATH_INFO: `/v3/users/8b377d55fa1045758102f54db838bbc4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:01.340544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b377d55fa1045758102f54db838bbc4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:01.342497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:01.389282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b377d55fa1045758102f54db838bbc4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.389941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b377d55fa1045758102f54db838bbc4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.396901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b377d55fa1045758102f54db838bbc4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.397525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b377d55fa1045758102f54db838bbc4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.409884 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-64f67cfa-aa35-4000-a589-00c72e0f1803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b377d55fa1045758102f54db838bbc4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.423204 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1351/2669] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:55:01 2022] DELETE /identity/v3/users/8b377d55fa1045758102f54db838bbc4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:01.697172 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:01.698638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:01.711775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cd7ab-3e91-406a-bce5-ccf445bd25ea admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:01.720979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:01.770330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:01.770975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:01.771219 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:01.771494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] PATH_INFO: `/v3/projects/c1cd05c5da3c4699ae8c53b6fd2ad6ce` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:01.772584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1cd05c5da3c4699ae8c53b6fd2ad6ce)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:01.775170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:01.818379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1cd05c5da3c4699ae8c53b6fd2ad6ce', 'request_id': 'req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.824287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1cd05c5da3c4699ae8c53b6fd2ad6ce', 'request_id': 'req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.831594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1cd05c5da3c4699ae8c53b6fd2ad6ce', 'request_id': 'req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.843041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] The token cache is being invalidate because project c1cd05c5da3c4699ae8c53b6fd2ad6ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:55:01.843335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.843960 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-f3e5fc5b-aafe-4639-a9f6-4ab03802cf74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:01.845479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1319/2670] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:55:01 2022] DELETE /identity/v3/projects/c1cd05c5da3c4699ae8c53b6fd2ad6ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:01.850470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b7586-ee64-48ef-984f-e9425c30b932 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:01.850944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b7586-ee64-48ef-984f-e9425c30b932 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:01.851043 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b7586-ee64-48ef-984f-e9425c30b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:01.870263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-023b7586-ee64-48ef-984f-e9425c30b932 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:01.871473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-023b7586-ee64-48ef-984f-e9425c30b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:01.902107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:01.931394 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1352/2671] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:01.940617 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63823f-4413-4db5-a49d-00abd4a5d754 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:01.940903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63823f-4413-4db5-a49d-00abd4a5d754 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:01.941178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63823f-4413-4db5-a49d-00abd4a5d754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:01.961379 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-6b63823f-4413-4db5-a49d-00abd4a5d754 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:01.962592 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6b63823f-4413-4db5-a49d-00abd4a5d754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:01.970302 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1320/2672] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:01.974507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b7586-ee64-48ef-984f-e9425c30b932 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:01.985026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b7586-ee64-48ef-984f-e9425c30b932 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:01.989527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:01.990159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:01.990442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:01.990719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:01.991367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:55:01.991708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:01.993302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:02.004567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1353/2673] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:55:02.009800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63823f-4413-4db5-a49d-00abd4a5d754 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:02.019037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63823f-4413-4db5-a49d-00abd4a5d754 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:02.024178 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe93d-8daa-463e-a686-4715019a4bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:02.024770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe93d-8daa-463e-a686-4715019a4bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:02.025050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe93d-8daa-463e-a686-4715019a4bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:02.025374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe93d-8daa-463e-a686-4715019a4bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:02.026013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fe93d-8daa-463e-a686-4715019a4bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:02.027944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fe93d-8daa-463e-a686-4715019a4bb7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:02.054071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1321/2674] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:55:02 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:02.058373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:02.068335 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708d923-b0f2-4a29-b2b8-e6e72fe54d84 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:02.125808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98ca4b-749e-4343-bf2f-4cf26353fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:02.126414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ca4b-749e-4343-bf2f-4cf26353fd19 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:02.126693 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ca4b-749e-4343-bf2f-4cf26353fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:02.126966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98ca4b-749e-4343-bf2f-4cf26353fd19 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:02.127599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98ca4b-749e-4343-bf2f-4cf26353fd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:02.129534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98ca4b-749e-4343-bf2f-4cf26353fd19 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:02.150891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1354/2675] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:55:02 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:55:02.155064 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe93d-8daa-463e-a686-4715019a4bb7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:02.165335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe93d-8daa-463e-a686-4715019a4bb7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:02.170041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f241f5d-53be-4629-ab2c-85d291ca1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:02.170644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f241f5d-53be-4629-ab2c-85d291ca1383 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:02.170928 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f241f5d-53be-4629-ab2c-85d291ca1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:02.171203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f241f5d-53be-4629-ab2c-85d291ca1383 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:02.171843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f241f5d-53be-4629-ab2c-85d291ca1383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:02.173486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f241f5d-53be-4629-ab2c-85d291ca1383 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:02.183881 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1322/2676] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:02.187844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98ca4b-749e-4343-bf2f-4cf26353fd19 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:02.198144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98ca4b-749e-4343-bf2f-4cf26353fd19 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:02.202956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd539e4-f119-4715-ac04-d1d89752ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:02.203545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd539e4-f119-4715-ac04-d1d89752ff9d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:02.203823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd539e4-f119-4715-ac04-d1d89752ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:02.204092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd539e4-f119-4715-ac04-d1d89752ff9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:02.204729 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd539e4-f119-4715-ac04-d1d89752ff9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:02.206345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd539e4-f119-4715-ac04-d1d89752ff9d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:02.216788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1355/2677] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:02.220686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f241f5d-53be-4629-ab2c-85d291ca1383 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:02.230530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f241f5d-53be-4629-ab2c-85d291ca1383 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:02.235154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:02.235805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:02.236089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:02.236371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] PATH_INFO: `/v3/projects/e5e9b8f0c1cc4fa7b2d80c36688b246e/users/52f8b944ded74cae993a011df5c14f32/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:02.251964 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e9b8f0c1cc4fa7b2d80c36688b246e, user_id=52f8b944ded74cae993a011df5c14f32, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:02.254662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:02.268249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1323/2678] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:02 2022] PUT /identity/v3/projects/e5e9b8f0c1cc4fa7b2d80c36688b246e/users/52f8b944ded74cae993a011df5c14f32/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:02.273395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d34cd-42a8-489e-a3d8-a2a9a2183c5a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:02.273781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d34cd-42a8-489e-a3d8-a2a9a2183c5a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:02.274081 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d34cd-42a8-489e-a3d8-a2a9a2183c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:02.292360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-883d34cd-42a8-489e-a3d8-a2a9a2183c5a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:02.293485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-883d34cd-42a8-489e-a3d8-a2a9a2183c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:02.349538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1356/2679] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:02.359047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:02.360707 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:02.403526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:02.418538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791932f-8197-4939-9f8b-557ade78d829 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:02.422270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22acce-f1a8-48cf-a9bf-f5fbea16d120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:02.422878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22acce-f1a8-48cf-a9bf-f5fbea16d120 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:02.423162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22acce-f1a8-48cf-a9bf-f5fbea16d120 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:02.423460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22acce-f1a8-48cf-a9bf-f5fbea16d120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:02.433153 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22acce-f1a8-48cf-a9bf-f5fbea16d120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:02.434690 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22acce-f1a8-48cf-a9bf-f5fbea16d120 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:02.443896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1324/2680] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:03.140495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f714d-c2d7-42ad-8811-2bc99fbc6621 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:03.141059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f714d-c2d7-42ad-8811-2bc99fbc6621 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:03.141059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f714d-c2d7-42ad-8811-2bc99fbc6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:03.170679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ca9f714d-c2d7-42ad-8811-2bc99fbc6621 None None] MFA Rules not processed for user `52f8b944ded74cae993a011df5c14f32`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:03.171853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ca9f714d-c2d7-42ad-8811-2bc99fbc6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:03.209205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:03.245033 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1357/2681] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:55:03.249650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22acce-f1a8-48cf-a9bf-f5fbea16d120 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:03.259486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22acce-f1a8-48cf-a9bf-f5fbea16d120 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:03.264367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbefd36-871d-40f8-9f98-cdc6ff86e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:03.265045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbefd36-871d-40f8-9f98-cdc6ff86e93a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:03.265399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbefd36-871d-40f8-9f98-cdc6ff86e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:03.265786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbefd36-871d-40f8-9f98-cdc6ff86e93a admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:03.266486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbefd36-871d-40f8-9f98-cdc6ff86e93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:03.268740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbefd36-871d-40f8-9f98-cdc6ff86e93a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:03.297642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1325/2682] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:55:03 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:55:03.300141 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f714d-c2d7-42ad-8811-2bc99fbc6621 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:03.311455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f714d-c2d7-42ad-8811-2bc99fbc6621 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:03.367298 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501759-272d-4aa4-97ff-8d1664e9006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:03.367906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501759-272d-4aa4-97ff-8d1664e9006b admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:03.368189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501759-272d-4aa4-97ff-8d1664e9006b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:03.368465 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501759-272d-4aa4-97ff-8d1664e9006b admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:03.369084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec501759-272d-4aa4-97ff-8d1664e9006b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:03.371044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec501759-272d-4aa4-97ff-8d1664e9006b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:03.391373 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1358/2683] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:55:03 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:03.395691 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbefd36-871d-40f8-9f98-cdc6ff86e93a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:03.405682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbefd36-871d-40f8-9f98-cdc6ff86e93a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:03.410341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7e4c-ed27-4519-ad81-ba741132c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:03.411039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7e4c-ed27-4519-ad81-ba741132c882 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:03.411393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7e4c-ed27-4519-ad81-ba741132c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:03.411675 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7e4c-ed27-4519-ad81-ba741132c882 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:03.412350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc7e4c-ed27-4519-ad81-ba741132c882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:03.414558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc7e4c-ed27-4519-ad81-ba741132c882 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:03.425403 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1326/2684] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:55:03.430209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501759-272d-4aa4-97ff-8d1664e9006b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:03.440004 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501759-272d-4aa4-97ff-8d1664e9006b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:03.444556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93963-3019-476b-9ce0-e76b8ab2a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:03.445201 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93963-3019-476b-9ce0-e76b8ab2a447 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:03.445489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93963-3019-476b-9ce0-e76b8ab2a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:03.445790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93963-3019-476b-9ce0-e76b8ab2a447 admin admin] PATH_INFO: `/v3/projects/b0b08dcb40fd44f398e14d0c398bbeac/users/e531aeae5ea9442f9815dd383e52eac8/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:03.460038 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93963-3019-476b-9ce0-e76b8ab2a447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b08dcb40fd44f398e14d0c398bbeac, user_id=e531aeae5ea9442f9815dd383e52eac8, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:03.462713 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93963-3019-476b-9ce0-e76b8ab2a447 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:03.474991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1359/2685] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:03 2022] PUT /identity/v3/projects/b0b08dcb40fd44f398e14d0c398bbeac/users/e531aeae5ea9442f9815dd383e52eac8/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:03.479401 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7e4c-ed27-4519-ad81-ba741132c882 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:03.489162 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7e4c-ed27-4519-ad81-ba741132c882 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:03.544055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa31b90-bf1c-4de1-a18e-eabc585e58f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:03.544659 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa31b90-bf1c-4de1-a18e-eabc585e58f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:03.544968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa31b90-bf1c-4de1-a18e-eabc585e58f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:03.545241 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa31b90-bf1c-4de1-a18e-eabc585e58f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:03.545910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa31b90-bf1c-4de1-a18e-eabc585e58f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:03.547526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa31b90-bf1c-4de1-a18e-eabc585e58f3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:03.557663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1327/2686] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:03.561724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93963-3019-476b-9ce0-e76b8ab2a447 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:03.571826 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93963-3019-476b-9ce0-e76b8ab2a447 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:03.576458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2777edc-7570-4bab-85dd-54f35a754cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:03.577098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2777edc-7570-4bab-85dd-54f35a754cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:03.577378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2777edc-7570-4bab-85dd-54f35a754cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:03.577682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2777edc-7570-4bab-85dd-54f35a754cc5 admin admin] PATH_INFO: `/v3/projects/b0b08dcb40fd44f398e14d0c398bbeac/users/e531aeae5ea9442f9815dd383e52eac8/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:03.579582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2777edc-7570-4bab-85dd-54f35a754cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b08dcb40fd44f398e14d0c398bbeac, user_id=e531aeae5ea9442f9815dd383e52eac8, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:03.582234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2777edc-7570-4bab-85dd-54f35a754cc5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:03.592246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1360/2687] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:03 2022] PUT /identity/v3/projects/b0b08dcb40fd44f398e14d0c398bbeac/users/e531aeae5ea9442f9815dd383e52eac8/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:04.218805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675012d7-a90f-4ee2-96db-95a0e809192e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:04.218805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675012d7-a90f-4ee2-96db-95a0e809192e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:04.218805 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675012d7-a90f-4ee2-96db-95a0e809192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:04.249748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-675012d7-a90f-4ee2-96db-95a0e809192e None None] MFA Rules not processed for user `e531aeae5ea9442f9815dd383e52eac8`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:04.251607 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-675012d7-a90f-4ee2-96db-95a0e809192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:04.339050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1328/2688] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:04.350457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84ac4-86dc-444d-a410-2f6319b9efca None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:04.351053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84ac4-86dc-444d-a410-2f6319b9efca None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:04.351053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84ac4-86dc-444d-a410-2f6319b9efca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:04.374556 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cec84ac4-86dc-444d-a410-2f6319b9efca None None] MFA Rules not processed for user `52f8b944ded74cae993a011df5c14f32`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:04.378157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cec84ac4-86dc-444d-a410-2f6319b9efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:04.454329 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1361/2689] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:04.465008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675012d7-a90f-4ee2-96db-95a0e809192e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:04.466419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-675012d7-a90f-4ee2-96db-95a0e809192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:04.500666 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:04.544036 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675012d7-a90f-4ee2-96db-95a0e809192e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:04.549684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:04.550298 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:04.550581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:04.550858 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:04.559149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:04.560755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:04.570468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1329/2690] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:04.945283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84ac4-86dc-444d-a410-2f6319b9efca None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:04.946733 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cec84ac4-86dc-444d-a410-2f6319b9efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:04.979497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:05.006945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84ac4-86dc-444d-a410-2f6319b9efca None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:05.010872 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:05.011657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:05.012074 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:05.012481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:05.014272 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:05.025770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:05.027345 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:05.035521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1362/2691] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:05.739399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:05.743669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:05.763487 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90109a81-ce41-4afc-ab95-d50cd72691ef service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:05.777051 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:05.777664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:05.777953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:05.778233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:05.789526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:05.808450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:05.810091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:05.823595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1330/2692] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:05.845640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:05.846680 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:05.964740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f3eb-ac38-441f-aaf3-f16c90eaef1b service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:05.970265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:05.970877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:05.971158 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:05.971429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:05.973445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:05.986605 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:05.988191 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:05.998745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1363/2693] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:09.737816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:09.747546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155b486-2920-48b7-942d-38bfb6c38a20 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:09.751167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:09.751764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:09.752077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:09.752333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:09.754111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:09.817496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:09.818903 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:09.829265 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1331/2694] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:13.081333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:13.096489 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21458e61-da9a-4333-8b20-55fdfd39199b service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:13.104755 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:13.105478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:13.105878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:13.106260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:13.108125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:13.124800 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:13.127490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:13.139317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1364/2695] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:13.174648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:13.176126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:13.195598 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4fa3f-e595-44b1-85cd-4baa57764f57 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:13.219283 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:13.221431 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:13.222137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:13.222421 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] PATH_INFO: `/v3/users/9c932f6c9f8b4e5d8eedfb5b597c0007` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:13.223824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c932f6c9f8b4e5d8eedfb5b597c0007)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:13.225860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:13.286892 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c932f6c9f8b4e5d8eedfb5b597c0007'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.287223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c932f6c9f8b4e5d8eedfb5b597c0007'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.294896 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c932f6c9f8b4e5d8eedfb5b597c0007'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.295558 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c932f6c9f8b4e5d8eedfb5b597c0007'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.304232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-a1f44e44-1c1a-4977-b7fe-b8e80886235b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c932f6c9f8b4e5d8eedfb5b597c0007'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.327085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1332/2696] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:55:13 2022] DELETE /identity/v3/users/9c932f6c9f8b4e5d8eedfb5b597c0007 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:13.518965 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:13.531854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c90a2d-c212-489a-bb65-b0129ee75f12 service placement] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:13.597456 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:13.598560 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:13.598953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:13.599225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] PATH_INFO: `/v3/projects/b9ca774a62914ed1ab7af85f365ad7b0` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:13.600346 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ca774a62914ed1ab7af85f365ad7b0)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:13.602305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:13.648161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ca774a62914ed1ab7af85f365ad7b0', 'request_id': 'req-87450f9c-2404-4ffa-92fa-2bfcfe612d05'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.649276 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:13.654854 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ca774a62914ed1ab7af85f365ad7b0', 'request_id': 'req-87450f9c-2404-4ffa-92fa-2bfcfe612d05'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.661070 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ca774a62914ed1ab7af85f365ad7b0', 'request_id': 'req-87450f9c-2404-4ffa-92fa-2bfcfe612d05'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.674678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] The token cache is being invalidate because project b9ca774a62914ed1ab7af85f365ad7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:55:13.674971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.675604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-87450f9c-2404-4ffa-92fa-2bfcfe612d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:13.677069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1365/2697] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:55:13 2022] DELETE /identity/v3/projects/b9ca774a62914ed1ab7af85f365ad7b0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:13.682327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621737-cb73-4876-b26c-0d3ce32f742b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:13.682692 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621737-cb73-4876-b26c-0d3ce32f742b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:13.682979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9621737-cb73-4876-b26c-0d3ce32f742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:13.702242 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f9621737-cb73-4876-b26c-0d3ce32f742b None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:13.703439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f9621737-cb73-4876-b26c-0d3ce32f742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:13.707553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:13.764315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1333/2698] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:13.774118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803cd0d-6a3f-4a59-b68d-3021eb9a19e9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:13.774466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803cd0d-6a3f-4a59-b68d-3021eb9a19e9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:13.774741 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803cd0d-6a3f-4a59-b68d-3021eb9a19e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:13.795899 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-8803cd0d-6a3f-4a59-b68d-3021eb9a19e9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:13.797113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8803cd0d-6a3f-4a59-b68d-3021eb9a19e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:13.805080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1366/2699] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:13.809481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9621737-cb73-4876-b26c-0d3ce32f742b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:13.819157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9621737-cb73-4876-b26c-0d3ce32f742b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:13.824233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:13.824832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:13.825117 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:13.825393 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:13.826149 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:55:13.826457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:13.828060 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:13.840011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1334/2700] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:55:13.844075 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803cd0d-6a3f-4a59-b68d-3021eb9a19e9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:13.853107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803cd0d-6a3f-4a59-b68d-3021eb9a19e9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:13.857678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe826-9661-467d-bbd8-942ee0f8f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:13.858265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe826-9661-467d-bbd8-942ee0f8f02b admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:13.858545 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe826-9661-467d-bbd8-942ee0f8f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:13.858815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe826-9661-467d-bbd8-942ee0f8f02b admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:13.859434 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe826-9661-467d-bbd8-942ee0f8f02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:13.861320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe826-9661-467d-bbd8-942ee0f8f02b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:13.887783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1367/2701] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:55:13 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:13.891995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:13.902663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfce80-bef6-487b-911b-a9cfa55673f4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:13.958879 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6a788-eb75-4cf8-a501-1e2f0ab5588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:13.959481 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6a788-eb75-4cf8-a501-1e2f0ab5588f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:13.959765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6a788-eb75-4cf8-a501-1e2f0ab5588f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:13.960041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6a788-eb75-4cf8-a501-1e2f0ab5588f admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:13.960667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6a788-eb75-4cf8-a501-1e2f0ab5588f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:13.962651 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6a788-eb75-4cf8-a501-1e2f0ab5588f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:13.984165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1335/2702] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:55:13 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:13.988143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe826-9661-467d-bbd8-942ee0f8f02b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:13.998768 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe826-9661-467d-bbd8-942ee0f8f02b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:14.003357 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324268d8-8dea-463b-ae63-33fd7d35b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:14.003944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324268d8-8dea-463b-ae63-33fd7d35b020 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:14.004223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324268d8-8dea-463b-ae63-33fd7d35b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:14.004500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324268d8-8dea-463b-ae63-33fd7d35b020 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:14.005136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324268d8-8dea-463b-ae63-33fd7d35b020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:14.006757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324268d8-8dea-463b-ae63-33fd7d35b020 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:14.017040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1368/2703] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:14.021079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6a788-eb75-4cf8-a501-1e2f0ab5588f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:14.031304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6a788-eb75-4cf8-a501-1e2f0ab5588f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:14.035920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15944347-5c5c-4cda-a214-7294c38cf072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:14.036509 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15944347-5c5c-4cda-a214-7294c38cf072 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:14.036793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15944347-5c5c-4cda-a214-7294c38cf072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:14.037071 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15944347-5c5c-4cda-a214-7294c38cf072 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:14.037741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15944347-5c5c-4cda-a214-7294c38cf072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:14.039361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15944347-5c5c-4cda-a214-7294c38cf072 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:14.049057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1336/2704] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:14.052957 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324268d8-8dea-463b-ae63-33fd7d35b020 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:14.062549 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324268d8-8dea-463b-ae63-33fd7d35b020 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:14.067083 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:14.067715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:14.067994 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:14.068268 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] PATH_INFO: `/v3/projects/b61b956b9c6a48538a31a0bd82665e7e/users/03b3ef8c5ddd407f9b1ab952f37f8c62/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:14.082825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61b956b9c6a48538a31a0bd82665e7e, user_id=03b3ef8c5ddd407f9b1ab952f37f8c62, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:14.086133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:14.098676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1369/2705] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:14 2022] PUT /identity/v3/projects/b61b956b9c6a48538a31a0bd82665e7e/users/03b3ef8c5ddd407f9b1ab952f37f8c62/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:14.103808 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0176-c5df-4fa6-8563-d6daa368aa82 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:14.104096 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0176-c5df-4fa6-8563-d6daa368aa82 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:14.104387 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0176-c5df-4fa6-8563-d6daa368aa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:14.124077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-448d0176-c5df-4fa6-8563-d6daa368aa82 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:14.125263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-448d0176-c5df-4fa6-8563-d6daa368aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:14.184040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1337/2706] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:14.193638 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:14.196067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:14.260046 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289a24c-11ce-42d9-b49e-a3789859dbcf admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:14.263871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ec056-024f-41f3-a4d0-7646335ba8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:14.264482 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec056-024f-41f3-a4d0-7646335ba8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:14.264762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec056-024f-41f3-a4d0-7646335ba8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:14.265036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ec056-024f-41f3-a4d0-7646335ba8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:14.274921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ec056-024f-41f3-a4d0-7646335ba8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:14.276503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ec056-024f-41f3-a4d0-7646335ba8c4 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:14.287480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1370/2707] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:14.336809 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d0176-c5df-4fa6-8563-d6daa368aa82 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:14.338367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-448d0176-c5df-4fa6-8563-d6daa368aa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:14.364406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:14.447372 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d0176-c5df-4fa6-8563-d6daa368aa82 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:14.454210 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:14.454829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:14.455110 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:14.455385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:14.457181 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:14.470339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:14.472478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:14.492811 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1338/2708] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:18.562947 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bfe97-1cde-4dd1-954e-c6dfd5909b99 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:18.563445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bfe97-1cde-4dd1-954e-c6dfd5909b99 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:18.563445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bfe97-1cde-4dd1-954e-c6dfd5909b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:18.599086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-0f0bfe97-1cde-4dd1-954e-c6dfd5909b99 None None] MFA Rules not processed for user `03b3ef8c5ddd407f9b1ab952f37f8c62`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:18.600311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0f0bfe97-1cde-4dd1-954e-c6dfd5909b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:18.708088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1371/2709] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:18.723837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:18.725817 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:18.734285 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bfe97-1cde-4dd1-954e-c6dfd5909b99 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:18.735778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-0f0bfe97-1cde-4dd1-954e-c6dfd5909b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:18.742466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94c83f-1fdd-46c4-8b79-142c399c4b9a service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:18.746685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:18.750504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784d570-1974-4b10-86f2-cc94fbd6f376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:18.751126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d570-1974-4b10-86f2-cc94fbd6f376 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:18.751412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d570-1974-4b10-86f2-cc94fbd6f376 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:18.751697 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d570-1974-4b10-86f2-cc94fbd6f376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:18.763463 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784d570-1974-4b10-86f2-cc94fbd6f376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:18.765185 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784d570-1974-4b10-86f2-cc94fbd6f376 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:18.776038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1339/2710] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:18.817323 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bfe97-1cde-4dd1-954e-c6dfd5909b99 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:18.822264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:18.822913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:18.823194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:18.823462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:18.825410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:18.895893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:18.897374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:18.907761 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1372/2711] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:55:20.620211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ae633-06fd-439f-9de8-2ff61796b441 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:20.620678 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ae633-06fd-439f-9de8-2ff61796b441 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:20.621084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ae633-06fd-439f-9de8-2ff61796b441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:20.640699 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3c2ae633-06fd-439f-9de8-2ff61796b441 None None] MFA Rules not processed for user `03b3ef8c5ddd407f9b1ab952f37f8c62`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:20.641931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3c2ae633-06fd-439f-9de8-2ff61796b441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:20.649773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1340/2712] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:20.962386 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:20.971914 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a6478-b75b-4989-a964-9589a2b9315e service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:20.975536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:20.976133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:20.976408 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:20.976675 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:20.978414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:20.987893 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:20.989305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:20.997962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1373/2713] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:30.636312 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=36 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:30.994241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=53 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:32.009190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ae633-06fd-439f-9de8-2ff61796b441 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:32.022531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ae633-06fd-439f-9de8-2ff61796b441 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:32.028451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:32.029080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:32.029350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:32.029648 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:32.031388 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:32.044931 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:32.046573 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:32.057957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1341/2714] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:37.900411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:37.901956 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:37.916305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4e4dd-560e-4cb4-865e-412a41dfb9db service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:37.921116 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:37.921907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:37.922192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:37.922469 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] PATH_INFO: `/v3/users/52f8b944ded74cae993a011df5c14f32` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:37.923620 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f8b944ded74cae993a011df5c14f32)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:37.925542 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:37.972937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f8b944ded74cae993a011df5c14f32'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:37.973525 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f8b944ded74cae993a011df5c14f32'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:37.980391 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f8b944ded74cae993a011df5c14f32'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:37.981027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f8b944ded74cae993a011df5c14f32'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:37.993900 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f8b944ded74cae993a011df5c14f32'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.006426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1374/2715] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:55:37 2022] DELETE /identity/v3/users/52f8b944ded74cae993a011df5c14f32 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:38.178026 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:38.191082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fbf412-1136-4d18-ab50-569b667affa7 service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:38.248203 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:38.248755 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:38.249031 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:38.249296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] PATH_INFO: `/v3/projects/e5e9b8f0c1cc4fa7b2d80c36688b246e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:38.250427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e9b8f0c1cc4fa7b2d80c36688b246e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:38.252311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:38.297314 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e9b8f0c1cc4fa7b2d80c36688b246e', 'request_id': 'req-b6c8d1a8-33c3-4053-b68d-4309311070e4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.302864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e9b8f0c1cc4fa7b2d80c36688b246e', 'request_id': 'req-b6c8d1a8-33c3-4053-b68d-4309311070e4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.310507 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e9b8f0c1cc4fa7b2d80c36688b246e', 'request_id': 'req-b6c8d1a8-33c3-4053-b68d-4309311070e4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.322377 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] The token cache is being invalidate because project e5e9b8f0c1cc4fa7b2d80c36688b246e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:55:38.322676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.323311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.324783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1342/2716] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:55:38 2022] DELETE /identity/v3/projects/e5e9b8f0c1cc4fa7b2d80c36688b246e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:38.328941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:38.330349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:38.343082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030c503-a85e-4665-8ec5-03d3157bfc7e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:38.401580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:38.402245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:38.402530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:38.402804 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] PATH_INFO: `/v3/users/e531aeae5ea9442f9815dd383e52eac8` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:38.403945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e531aeae5ea9442f9815dd383e52eac8)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:38.405902 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:38.454876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e531aeae5ea9442f9815dd383e52eac8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.455539 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e531aeae5ea9442f9815dd383e52eac8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.462864 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e531aeae5ea9442f9815dd383e52eac8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.463500 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e531aeae5ea9442f9815dd383e52eac8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.475101 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-68e30107-cab8-4919-9383-8ade18417007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e531aeae5ea9442f9815dd383e52eac8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.477293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:38.489372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1375/2717] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:55:38 2022] DELETE /identity/v3/users/e531aeae5ea9442f9815dd383e52eac8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:38.659753 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:38.661196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:38.674038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8d1a8-33c3-4053-b68d-4309311070e4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:38.729783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:38.730411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:38.730686 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:38.730957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] PATH_INFO: `/v3/projects/b0b08dcb40fd44f398e14d0c398bbeac` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:38.732441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b08dcb40fd44f398e14d0c398bbeac)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:38.734414 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:38.754589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:38.781920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b08dcb40fd44f398e14d0c398bbeac', 'request_id': 'req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.787378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b08dcb40fd44f398e14d0c398bbeac', 'request_id': 'req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.793984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b08dcb40fd44f398e14d0c398bbeac', 'request_id': 'req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.804685 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] The token cache is being invalidate because project b0b08dcb40fd44f398e14d0c398bbeac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:55:38.804994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.805705 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e11ddfb-a250-4d18-801f-b35cc0bcfbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:38.807220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1343/2718] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:55:38 2022] DELETE /identity/v3/projects/b0b08dcb40fd44f398e14d0c398bbeac => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:38.812271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40bbda-e01b-4818-af2b-951186d1afbf None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:38.812563 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40bbda-e01b-4818-af2b-951186d1afbf None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:38.812839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40bbda-e01b-4818-af2b-951186d1afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:38.833428 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-cc40bbda-e01b-4818-af2b-951186d1afbf None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:38.834666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-cc40bbda-e01b-4818-af2b-951186d1afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:38.892331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1376/2719] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:38.900375 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196050e7-cc6a-4835-9eb7-d813c213c203 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:38.900662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196050e7-cc6a-4835-9eb7-d813c213c203 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:38.900939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196050e7-cc6a-4835-9eb7-d813c213c203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:38.920423 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-196050e7-cc6a-4835-9eb7-d813c213c203 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:38.921658 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-196050e7-cc6a-4835-9eb7-d813c213c203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:38.930070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1344/2720] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:38.934163 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40bbda-e01b-4818-af2b-951186d1afbf None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:38.943534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40bbda-e01b-4818-af2b-951186d1afbf None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:38.948546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:38.949138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:38.949414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:38.949719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:38.950362 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:55:38.950667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:38.952246 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:38.963470 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1377/2721] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:55:38.967560 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196050e7-cc6a-4835-9eb7-d813c213c203 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:38.976632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196050e7-cc6a-4835-9eb7-d813c213c203 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:38.981240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dda1c-39ee-4351-a4ae-f902ef5dc703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:38.981873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dda1c-39ee-4351-a4ae-f902ef5dc703 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:38.982157 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dda1c-39ee-4351-a4ae-f902ef5dc703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:38.982434 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dda1c-39ee-4351-a4ae-f902ef5dc703 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:38.983069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dda1c-39ee-4351-a4ae-f902ef5dc703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:38.984968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dda1c-39ee-4351-a4ae-f902ef5dc703 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.014271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1345/2722] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:55:38 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:39.018797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.028677 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f42788-1d80-4768-a46d-66f8786029dc admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.086815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143c4b-fdc6-4cdb-a00d-986730ead561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.087374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143c4b-fdc6-4cdb-a00d-986730ead561 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.087656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143c4b-fdc6-4cdb-a00d-986730ead561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.087933 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df143c4b-fdc6-4cdb-a00d-986730ead561 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.088552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df143c4b-fdc6-4cdb-a00d-986730ead561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.090540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df143c4b-fdc6-4cdb-a00d-986730ead561 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.115717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1378/2723] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:55:39 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:55:39.117986 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dda1c-39ee-4351-a4ae-f902ef5dc703 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.129824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dda1c-39ee-4351-a4ae-f902ef5dc703 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.135295 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d36af-8dee-410b-b580-8cb000f59059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.135893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d36af-8dee-410b-b580-8cb000f59059 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.136174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d36af-8dee-410b-b580-8cb000f59059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.136446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d36af-8dee-410b-b580-8cb000f59059 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.137112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d36af-8dee-410b-b580-8cb000f59059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.138780 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d36af-8dee-410b-b580-8cb000f59059 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.148778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1346/2724] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:39.152526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143c4b-fdc6-4cdb-a00d-986730ead561 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.162209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df143c4b-fdc6-4cdb-a00d-986730ead561 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.166736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54524539-15e8-4570-8d43-45ff570d01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.167321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54524539-15e8-4570-8d43-45ff570d01d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.167604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54524539-15e8-4570-8d43-45ff570d01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.167878 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54524539-15e8-4570-8d43-45ff570d01d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.168513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54524539-15e8-4570-8d43-45ff570d01d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.170136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54524539-15e8-4570-8d43-45ff570d01d4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.180897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1379/2725] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:39.184619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d36af-8dee-410b-b580-8cb000f59059 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.194324 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d36af-8dee-410b-b580-8cb000f59059 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.199473 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c79771-6d27-4850-891d-d627bcfe2dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.200112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c79771-6d27-4850-891d-d627bcfe2dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.200394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c79771-6d27-4850-891d-d627bcfe2dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.200670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c79771-6d27-4850-891d-d627bcfe2dc8 admin admin] PATH_INFO: `/v3/projects/c04686a216d54e96850fbce836135614/users/9a180eece3b84eb6af64d048c9db703a/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.214979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c79771-6d27-4850-891d-d627bcfe2dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04686a216d54e96850fbce836135614, user_id=9a180eece3b84eb6af64d048c9db703a, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.217784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c79771-6d27-4850-891d-d627bcfe2dc8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.231040 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1347/2726] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:39 2022] PUT /identity/v3/projects/c04686a216d54e96850fbce836135614/users/9a180eece3b84eb6af64d048c9db703a/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:39.242399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473543-9b32-4de7-93a9-cd86aa7b1df7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.242683 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473543-9b32-4de7-93a9-cd86aa7b1df7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.242962 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473543-9b32-4de7-93a9-cd86aa7b1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.270390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-63473543-9b32-4de7-93a9-cd86aa7b1df7 None None] MFA Rules not processed for user `9a180eece3b84eb6af64d048c9db703a`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:39.271580 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-63473543-9b32-4de7-93a9-cd86aa7b1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:39.314521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:39.335951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1380/2727] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:39.340502 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c79771-6d27-4850-891d-d627bcfe2dc8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.401341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c79771-6d27-4850-891d-d627bcfe2dc8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.405946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148078ff-972f-4b94-a8b9-69e5f4aca50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.406548 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148078ff-972f-4b94-a8b9-69e5f4aca50f admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.406828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148078ff-972f-4b94-a8b9-69e5f4aca50f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.407101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148078ff-972f-4b94-a8b9-69e5f4aca50f admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.407716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148078ff-972f-4b94-a8b9-69e5f4aca50f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.409642 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148078ff-972f-4b94-a8b9-69e5f4aca50f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.436207 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1348/2728] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:55:39 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:39.440416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63473543-9b32-4de7-93a9-cd86aa7b1df7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.451370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63473543-9b32-4de7-93a9-cd86aa7b1df7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.506138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cdf4a-032d-4647-b3b2-6347ad629fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.507275 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cdf4a-032d-4647-b3b2-6347ad629fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.507561 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cdf4a-032d-4647-b3b2-6347ad629fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.507839 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cdf4a-032d-4647-b3b2-6347ad629fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.508475 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cdf4a-032d-4647-b3b2-6347ad629fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.510431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9cdf4a-032d-4647-b3b2-6347ad629fb6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.532194 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1381/2729] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:55:39 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:39.536208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148078ff-972f-4b94-a8b9-69e5f4aca50f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.546347 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148078ff-972f-4b94-a8b9-69e5f4aca50f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.550898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fdb6a-48fa-4dd2-8063-38b67337d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.551491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fdb6a-48fa-4dd2-8063-38b67337d6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.551778 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fdb6a-48fa-4dd2-8063-38b67337d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.552076 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fdb6a-48fa-4dd2-8063-38b67337d6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.552684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fdb6a-48fa-4dd2-8063-38b67337d6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.554315 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fdb6a-48fa-4dd2-8063-38b67337d6a6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.564747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1349/2730] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:39.568603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cdf4a-032d-4647-b3b2-6347ad629fb6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.578727 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cdf4a-032d-4647-b3b2-6347ad629fb6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.583290 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a0ee7-2fb9-4811-88db-b310c92f5fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.583929 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a0ee7-2fb9-4811-88db-b310c92f5fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.584211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a0ee7-2fb9-4811-88db-b310c92f5fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.584485 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a0ee7-2fb9-4811-88db-b310c92f5fb9 admin admin] PATH_INFO: `/v3/projects/d51f101ed8e1458baf162348974d72ff/users/15cf59967251464da050dd2ad3cc790a/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.599368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a0ee7-2fb9-4811-88db-b310c92f5fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51f101ed8e1458baf162348974d72ff, user_id=15cf59967251464da050dd2ad3cc790a, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.601996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a0ee7-2fb9-4811-88db-b310c92f5fb9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.615352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1382/2731] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:39 2022] PUT /identity/v3/projects/d51f101ed8e1458baf162348974d72ff/users/15cf59967251464da050dd2ad3cc790a/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:39.619653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fdb6a-48fa-4dd2-8063-38b67337d6a6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.629609 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fdb6a-48fa-4dd2-8063-38b67337d6a6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.642441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:39.688769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e3653-2475-4ae0-b70b-492d1d87213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.689399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3653-2475-4ae0-b70b-492d1d87213b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.689722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3653-2475-4ae0-b70b-492d1d87213b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.689993 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e3653-2475-4ae0-b70b-492d1d87213b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.690622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e3653-2475-4ae0-b70b-492d1d87213b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.692218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e3653-2475-4ae0-b70b-492d1d87213b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.702559 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1350/2732] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:39.706575 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a0ee7-2fb9-4811-88db-b310c92f5fb9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.716538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a0ee7-2fb9-4811-88db-b310c92f5fb9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.721032 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.721697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.721977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.722247 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] PATH_INFO: `/v3/projects/d51f101ed8e1458baf162348974d72ff/users/15cf59967251464da050dd2ad3cc790a/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.724134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51f101ed8e1458baf162348974d72ff, user_id=15cf59967251464da050dd2ad3cc790a, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.726796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.736921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1383/2733] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:39 2022] PUT /identity/v3/projects/d51f101ed8e1458baf162348974d72ff/users/15cf59967251464da050dd2ad3cc790a/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:55:39.747426 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87e22-01f4-4b47-82f8-1e9be846223b None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.747715 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87e22-01f4-4b47-82f8-1e9be846223b None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.747989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e87e22-01f4-4b47-82f8-1e9be846223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.775886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-75e87e22-01f4-4b47-82f8-1e9be846223b None None] MFA Rules not processed for user `15cf59967251464da050dd2ad3cc790a`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:39.777082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-75e87e22-01f4-4b47-82f8-1e9be846223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:39.843027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1351/2734] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:39.853252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:39.854976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:39.910318 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cefa2-6102-4409-9c28-6e8bda13f9b3 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:39.913917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762efa1-adc9-450c-ae64-9bddad535e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:39.914503 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762efa1-adc9-450c-ae64-9bddad535e7f service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:39.914781 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762efa1-adc9-450c-ae64-9bddad535e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:39.915049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762efa1-adc9-450c-ae64-9bddad535e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:39.965514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:39.969695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762efa1-adc9-450c-ae64-9bddad535e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:39.971171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762efa1-adc9-450c-ae64-9bddad535e7f service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:39.980568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1384/2735] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:44.175977 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87e22-01f4-4b47-82f8-1e9be846223b None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:44.177354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-75e87e22-01f4-4b47-82f8-1e9be846223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:44.188873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e87e22-01f4-4b47-82f8-1e9be846223b None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:44.192578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61fd27-9f39-447a-b7fb-04948d556711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:44.193184 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61fd27-9f39-447a-b7fb-04948d556711 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:44.193466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61fd27-9f39-447a-b7fb-04948d556711 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:44.193789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61fd27-9f39-447a-b7fb-04948d556711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:44.202677 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61fd27-9f39-447a-b7fb-04948d556711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:44.204104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61fd27-9f39-447a-b7fb-04948d556711 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:44.213912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1352/2736] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:49.082455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762efa1-adc9-450c-ae64-9bddad535e7f service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:49.144796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762efa1-adc9-450c-ae64-9bddad535e7f service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:49.149827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:49.150458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:49.150739 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:49.151015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] PATH_INFO: `/v3/users/9a180eece3b84eb6af64d048c9db703a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:49.152136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a180eece3b84eb6af64d048c9db703a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:49.154099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:49.199066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a180eece3b84eb6af64d048c9db703a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.199719 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a180eece3b84eb6af64d048c9db703a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.206613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a180eece3b84eb6af64d048c9db703a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.207265 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a180eece3b84eb6af64d048c9db703a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.221358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a180eece3b84eb6af64d048c9db703a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.234534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1385/2737] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:55:49 2022] DELETE /identity/v3/users/9a180eece3b84eb6af64d048c9db703a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:49.239082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e5fa4-a87b-413c-8a8d-b8eb08670e2e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:49.239557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e5fa4-a87b-413c-8a8d-b8eb08670e2e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:49.239683 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e5fa4-a87b-413c-8a8d-b8eb08670e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:49.258769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-d99e5fa4-a87b-413c-8a8d-b8eb08670e2e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:49.259968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d99e5fa4-a87b-413c-8a8d-b8eb08670e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:49.316769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1353/2738] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:49.326871 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:49.328348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:49.384923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79358c-4252-44b1-949e-aca277a61250 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:49.388597 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f999d-bdd1-41b2-8195-3c6febb83e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:49.389195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f999d-bdd1-41b2-8195-3c6febb83e8a service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:49.389474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f999d-bdd1-41b2-8195-3c6febb83e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:49.389784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f999d-bdd1-41b2-8195-3c6febb83e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:49.398842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f999d-bdd1-41b2-8195-3c6febb83e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:49.400252 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f999d-bdd1-41b2-8195-3c6febb83e8a service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:49.409521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1386/2739] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:49.666250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e5fa4-a87b-413c-8a8d-b8eb08670e2e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:49.667750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d99e5fa4-a87b-413c-8a8d-b8eb08670e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:49.680394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e5fa4-a87b-413c-8a8d-b8eb08670e2e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:49.685115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:49.685788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:49.686068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:49.686340 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] PATH_INFO: `/v3/projects/c04686a216d54e96850fbce836135614` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:49.687465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04686a216d54e96850fbce836135614)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:49.689493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:49.712196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=100 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:49.735672 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04686a216d54e96850fbce836135614', 'request_id': 'req-790c36cd-0fd1-45f2-93ca-4d931573e61a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.741208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04686a216d54e96850fbce836135614', 'request_id': 'req-790c36cd-0fd1-45f2-93ca-4d931573e61a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.748840 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04686a216d54e96850fbce836135614', 'request_id': 'req-790c36cd-0fd1-45f2-93ca-4d931573e61a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.759526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] The token cache is being invalidate because project c04686a216d54e96850fbce836135614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:55:49.759835 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.760451 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.761930 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1354/2740] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:55:49 2022] DELETE /identity/v3/projects/c04686a216d54e96850fbce836135614 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:49.766056 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f999d-bdd1-41b2-8195-3c6febb83e8a service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:49.776920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f999d-bdd1-41b2-8195-3c6febb83e8a service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:49.787942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:49.837468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:49.838118 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:49.838395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:49.838663 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] PATH_INFO: `/v3/users/15cf59967251464da050dd2ad3cc790a` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:49.839783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cf59967251464da050dd2ad3cc790a)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:49.841908 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:49.886203 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cf59967251464da050dd2ad3cc790a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.886849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cf59967251464da050dd2ad3cc790a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.893891 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cf59967251464da050dd2ad3cc790a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.894528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cf59967251464da050dd2ad3cc790a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.906777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-dfcc68ce-186b-4d74-bbd7-08d57bb1a0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cf59967251464da050dd2ad3cc790a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:49.919629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1387/2741] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:55:49 2022] DELETE /identity/v3/users/15cf59967251464da050dd2ad3cc790a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:50.193270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:50.194783 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:50.208321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c36cd-0fd1-45f2-93ca-4d931573e61a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:50.265063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:50.265807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.265994 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.266270 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] PATH_INFO: `/v3/projects/d51f101ed8e1458baf162348974d72ff` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.267369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51f101ed8e1458baf162348974d72ff)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:50.269551 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:50.315078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51f101ed8e1458baf162348974d72ff', 'request_id': 'req-20349556-d5bd-42d6-b69c-28571ad9e26a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:50.320534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51f101ed8e1458baf162348974d72ff', 'request_id': 'req-20349556-d5bd-42d6-b69c-28571ad9e26a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:50.327367 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51f101ed8e1458baf162348974d72ff', 'request_id': 'req-20349556-d5bd-42d6-b69c-28571ad9e26a'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:50.338623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] The token cache is being invalidate because project d51f101ed8e1458baf162348974d72ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:55:50.338914 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:50.339567 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-20349556-d5bd-42d6-b69c-28571ad9e26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:55:50.341023 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1355/2742] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:55:50 2022] DELETE /identity/v3/projects/d51f101ed8e1458baf162348974d72ff => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:50.347212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0446f-5cce-4341-bf44-31cd1d16628d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.347703 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0446f-5cce-4341-bf44-31cd1d16628d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.347802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0446f-5cce-4341-bf44-31cd1d16628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.368537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-15d0446f-5cce-4341-bf44-31cd1d16628d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:50.369780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-15d0446f-5cce-4341-bf44-31cd1d16628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:50.427601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1388/2743] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:50.437427 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1dccf-402d-42f8-bb0b-6acac7e7c438 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.437749 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1dccf-402d-42f8-bb0b-6acac7e7c438 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.438057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1dccf-402d-42f8-bb0b-6acac7e7c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.457819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-dee1dccf-402d-42f8-bb0b-6acac7e7c438 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:50.459013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-dee1dccf-402d-42f8-bb0b-6acac7e7c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:50.467419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1356/2744] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:50.471622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0446f-5cce-4341-bf44-31cd1d16628d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:50.481185 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0446f-5cce-4341-bf44-31cd1d16628d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:50.485749 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:50.486340 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.486623 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.486897 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.487538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:55:50.487845 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:50.489464 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:50.500813 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1389/2745] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:55:50.504920 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1dccf-402d-42f8-bb0b-6acac7e7c438 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:50.514557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1dccf-402d-42f8-bb0b-6acac7e7c438 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:50.519458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82e38-cf1a-45cf-b349-cb63f036cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:50.520047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82e38-cf1a-45cf-b349-cb63f036cb48 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.520327 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82e38-cf1a-45cf-b349-cb63f036cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.520601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f82e38-cf1a-45cf-b349-cb63f036cb48 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.521262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f82e38-cf1a-45cf-b349-cb63f036cb48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:50.523841 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f82e38-cf1a-45cf-b349-cb63f036cb48 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:50.549685 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1357/2746] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:55:50 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:50.553809 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:50.563708 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe2f-bfb2-4740-8698-ac2187ba7b03 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:50.582264 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:50.621136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ccad-334a-4bf0-bcf0-ee890cabb11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:50.621765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ccad-334a-4bf0-bcf0-ee890cabb11e admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.622051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ccad-334a-4bf0-bcf0-ee890cabb11e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.622326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0ccad-334a-4bf0-bcf0-ee890cabb11e admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.622953 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ccad-334a-4bf0-bcf0-ee890cabb11e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:50.624873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0ccad-334a-4bf0-bcf0-ee890cabb11e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:50.645629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1390/2747] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:55:50 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:55:50.650254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82e38-cf1a-45cf-b349-cb63f036cb48 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:50.660462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f82e38-cf1a-45cf-b349-cb63f036cb48 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:50.665154 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4e95-aecb-4846-b693-ab1e2fcaa302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:50.665788 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4e95-aecb-4846-b693-ab1e2fcaa302 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.666075 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4e95-aecb-4846-b693-ab1e2fcaa302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.666354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4e95-aecb-4846-b693-ab1e2fcaa302 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.666991 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb4e95-aecb-4846-b693-ab1e2fcaa302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:50.668596 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb4e95-aecb-4846-b693-ab1e2fcaa302 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:50.673729 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:50.679299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1358/2748] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:50.683020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ccad-334a-4bf0-bcf0-ee890cabb11e admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:50.692660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0ccad-334a-4bf0-bcf0-ee890cabb11e admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:50.697784 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c9fd-eed5-4593-8dc9-d56afe5ddeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:50.698375 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c9fd-eed5-4593-8dc9-d56afe5ddeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.698658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c9fd-eed5-4593-8dc9-d56afe5ddeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.698934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c9fd-eed5-4593-8dc9-d56afe5ddeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.699569 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0c9fd-eed5-4593-8dc9-d56afe5ddeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:50.701157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0c9fd-eed5-4593-8dc9-d56afe5ddeb6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:50.712239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1391/2749] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:50.716092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4e95-aecb-4846-b693-ab1e2fcaa302 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:50.725827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4e95-aecb-4846-b693-ab1e2fcaa302 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:50.730390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:50.731028 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.731308 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.731637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] PATH_INFO: `/v3/projects/5200c817a11d4a998e109af24e5c729b/users/630da4f1316947458d89eef6376e47a4/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.747115 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5200c817a11d4a998e109af24e5c729b, user_id=630da4f1316947458d89eef6376e47a4, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:50.749765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:50.762594 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1359/2750] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:50 2022] PUT /identity/v3/projects/5200c817a11d4a998e109af24e5c729b/users/630da4f1316947458d89eef6376e47a4/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:50.767987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24887e6-3ded-46ec-93d9-bcb3e651bd90 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.768277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24887e6-3ded-46ec-93d9-bcb3e651bd90 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.768553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24887e6-3ded-46ec-93d9-bcb3e651bd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.792754 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d24887e6-3ded-46ec-93d9-bcb3e651bd90 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:50.794005 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d24887e6-3ded-46ec-93d9-bcb3e651bd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:50.850682 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1392/2751] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:50.924287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:50.926007 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:50.982452 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ebd3b-69c4-46f8-83c1-e76e99c23510 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:50.986138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628b42-2427-480b-b98d-915fd14026b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:50.986741 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628b42-2427-480b-b98d-915fd14026b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:50.987027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628b42-2427-480b-b98d-915fd14026b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:50.987301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628b42-2427-480b-b98d-915fd14026b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:50.996188 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84628b42-2427-480b-b98d-915fd14026b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:50.997653 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84628b42-2427-480b-b98d-915fd14026b8 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:51.006873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1360/2752] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:55:54.841467 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4f44-eb64-4b67-aad8-9049d78a7456 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:54.841977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4f44-eb64-4b67-aad8-9049d78a7456 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:54.842073 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4f44-eb64-4b67-aad8-9049d78a7456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:54.869858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-3a7f4f44-eb64-4b67-aad8-9049d78a7456 None None] MFA Rules not processed for user `630da4f1316947458d89eef6376e47a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:54.871066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3a7f4f44-eb64-4b67-aad8-9049d78a7456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:54.943699 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1393/2753] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:55:54.948775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628b42-2427-480b-b98d-915fd14026b8 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:54.959019 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628b42-2427-480b-b98d-915fd14026b8 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:54.963862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cee77-b19a-4321-806a-979fd451c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:54.964465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cee77-b19a-4321-806a-979fd451c0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:54.964745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cee77-b19a-4321-806a-979fd451c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:54.965020 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cee77-b19a-4321-806a-979fd451c0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:54.965694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cee77-b19a-4321-806a-979fd451c0e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:54.967626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cee77-b19a-4321-806a-979fd451c0e7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:55.002782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1361/2754] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:55:54 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:55:55.007035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4f44-eb64-4b67-aad8-9049d78a7456 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:55.018537 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4f44-eb64-4b67-aad8-9049d78a7456 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:55.048852 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:55:55.078119 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9430ca-4b1b-4456-a58f-48707f549173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:55.078746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9430ca-4b1b-4456-a58f-48707f549173 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:55.079031 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9430ca-4b1b-4456-a58f-48707f549173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:55.079310 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9430ca-4b1b-4456-a58f-48707f549173 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:55.079958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9430ca-4b1b-4456-a58f-48707f549173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:55.081969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9430ca-4b1b-4456-a58f-48707f549173 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:55.104849 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1394/2755] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:55:55 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:55:55.108752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cee77-b19a-4321-806a-979fd451c0e7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:55.120624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cee77-b19a-4321-806a-979fd451c0e7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:55.125460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8da8e-84dc-4108-9ea4-c8d283f47ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:55.126118 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8da8e-84dc-4108-9ea4-c8d283f47ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:55.126405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8da8e-84dc-4108-9ea4-c8d283f47ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:55.126681 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8da8e-84dc-4108-9ea4-c8d283f47ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:55.127390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8da8e-84dc-4108-9ea4-c8d283f47ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:55.129046 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8da8e-84dc-4108-9ea4-c8d283f47ef0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:55.157529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1362/2756] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:55.157919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9430ca-4b1b-4456-a58f-48707f549173 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:55.178107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9430ca-4b1b-4456-a58f-48707f549173 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:55.183344 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a4f9e-4ce5-499f-b257-8b363fb1cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:55.183993 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4f9e-4ce5-499f-b257-8b363fb1cedd admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:55.184297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4f9e-4ce5-499f-b257-8b363fb1cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:55.184567 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4f9e-4ce5-499f-b257-8b363fb1cedd admin admin] PATH_INFO: `/v3/projects/c81b6e3dd9a3484e8fe3684a0bbefd4f/users/9ecae5ff323a4541ba7eb853419c9495/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:55.203778 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a4f9e-4ce5-499f-b257-8b363fb1cedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81b6e3dd9a3484e8fe3684a0bbefd4f, user_id=9ecae5ff323a4541ba7eb853419c9495, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:55.206889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a4f9e-4ce5-499f-b257-8b363fb1cedd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:55.221447 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1395/2757] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:55 2022] PUT /identity/v3/projects/c81b6e3dd9a3484e8fe3684a0bbefd4f/users/9ecae5ff323a4541ba7eb853419c9495/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:55.225480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8da8e-84dc-4108-9ea4-c8d283f47ef0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:55.239508 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8da8e-84dc-4108-9ea4-c8d283f47ef0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:55.310701 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dc522-5d54-484b-ab04-482897a5d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:55.311339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc522-5d54-484b-ab04-482897a5d716 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:55.311632 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc522-5d54-484b-ab04-482897a5d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:55.311906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dc522-5d54-484b-ab04-482897a5d716 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:55.314536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dc522-5d54-484b-ab04-482897a5d716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:55.316249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dc522-5d54-484b-ab04-482897a5d716 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:55.328793 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1363/2758] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:55:55.332811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a4f9e-4ce5-499f-b257-8b363fb1cedd admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:55:55.344177 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a4f9e-4ce5-499f-b257-8b363fb1cedd admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:55:55.350088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:55:55.350791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:55.351077 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:55.351349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] PATH_INFO: `/v3/projects/c81b6e3dd9a3484e8fe3684a0bbefd4f/users/9ecae5ff323a4541ba7eb853419c9495/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:55.353932 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81b6e3dd9a3484e8fe3684a0bbefd4f, user_id=9ecae5ff323a4541ba7eb853419c9495, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:55:55.356625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:55:55.368371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1396/2759] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:55:55 2022] PUT /identity/v3/projects/c81b6e3dd9a3484e8fe3684a0bbefd4f/users/9ecae5ff323a4541ba7eb853419c9495/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:55:59.860588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292cccf-ee51-4c12-929e-e01233067f25 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:55:59.860588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292cccf-ee51-4c12-929e-e01233067f25 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:55:59.860588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292cccf-ee51-4c12-929e-e01233067f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:55:59.915713 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9292cccf-ee51-4c12-929e-e01233067f25 None None] MFA Rules not processed for user `9ecae5ff323a4541ba7eb853419c9495`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:55:59.917301 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9292cccf-ee51-4c12-929e-e01233067f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:55:59.955523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:56:00.001826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1364/2760] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:55:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:56:00.018950 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:56:00.021105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:56:00.090738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62399e86-bd35-40f2-8e4d-07ce1a3c6974 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:56:00.094876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdb8a57a383c475caff51c3d6d5c6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:56:00.095629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:56:00.096014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:56:00.096392 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:56:00.166644 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:56:00.168379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:56:00.177889 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1397/2761] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:56:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:56:00.311478 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f124-a432-479d-8b4f-a51e5489cc67 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:56:00.311859 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f124-a432-479d-8b4f-a51e5489cc67 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:56:00.312206 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9f124-a432-479d-8b4f-a51e5489cc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:56:00.332557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-9df9f124-a432-479d-8b4f-a51e5489cc67 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:56:00.334479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9df9f124-a432-479d-8b4f-a51e5489cc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:56:00.398053 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1365/2762] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:56:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:56:00.448562 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:56:00.450050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:56:00.493782 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:56:00.528765 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483478e-f71a-4c44-9061-52e2a53df49d service glance] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:56:00.534211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60516-996d-4557-831b-3ffdec2a22a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:56:00.534828 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60516-996d-4557-831b-3ffdec2a22a9 service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:56:00.535112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60516-996d-4557-831b-3ffdec2a22a9 service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:56:00.535388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60516-996d-4557-831b-3ffdec2a22a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:56:00.543745 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b60516-996d-4557-831b-3ffdec2a22a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:56:00.545317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b60516-996d-4557-831b-3ffdec2a22a9 service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:56:00.553147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1398/2763] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:56:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:56:09.335553 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873dc1-7d98-4449-98b3-638f9ae47e52 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:56:09.336607 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873dc1-7d98-4449-98b3-638f9ae47e52 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:56:09.337158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7873dc1-7d98-4449-98b3-638f9ae47e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:56:09.358800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-b7873dc1-7d98-4449-98b3-638f9ae47e52 None None] MFA Rules not processed for user `630da4f1316947458d89eef6376e47a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:56:09.360725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b7873dc1-7d98-4449-98b3-638f9ae47e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:56:09.369446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1366/2764] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:56:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:56:10.549530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b655a-0ed2-4bfa-8049-ccd6fde83e68 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:56:10.550106 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b655a-0ed2-4bfa-8049-ccd6fde83e68 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:56:10.550220 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b655a-0ed2-4bfa-8049-ccd6fde83e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:56:10.553361 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=15 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:56:10.571986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-e49b655a-0ed2-4bfa-8049-ccd6fde83e68 None None] MFA Rules not processed for user `03b3ef8c5ddd407f9b1ab952f37f8c62`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:56:10.573186 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e49b655a-0ed2-4bfa-8049-ccd6fde83e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:56:10.630326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1399/2765] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:56:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:56:11.553505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48851-2306-48a7-a8bd-78d3a3737683 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:56:11.554054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48851-2306-48a7-a8bd-78d3a3737683 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:56:11.554341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef48851-2306-48a7-a8bd-78d3a3737683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:56:11.576627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-3ef48851-2306-48a7-a8bd-78d3a3737683 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:56:11.578032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3ef48851-2306-48a7-a8bd-78d3a3737683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:56:11.585437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1367/2766] 10.222.0.30 () {58 vars in 1009 bytes} [Tue Oct 4 12:56:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:56:11.601385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b655a-0ed2-4bfa-8049-ccd6fde83e68 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:56:11.614594 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b655a-0ed2-4bfa-8049-ccd6fde83e68 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:56:11.620462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:56:11.621347 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:56:11.621831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:56:11.622109 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:56:11.630907 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:56:11.632523 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:56:11.643502 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1400/2767] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:56:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:56:21.570794 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=46 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:56:21.639696 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=31 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:56:32.279057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef48851-2306-48a7-a8bd-78d3a3737683 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:56:32.280469 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3ef48851-2306-48a7-a8bd-78d3a3737683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:56:32.344017 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef48851-2306-48a7-a8bd-78d3a3737683 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:56:32.347799 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b59b1-259b-4a35-b5a8-92bd45b796b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:56:32.348876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b59b1-259b-4a35-b5a8-92bd45b796b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:56:32.348876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b59b1-259b-4a35-b5a8-92bd45b796b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:56:32.349105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b59b1-259b-4a35-b5a8-92bd45b796b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:56:32.359304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b59b1-259b-4a35-b5a8-92bd45b796b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:56:32.360757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b59b1-259b-4a35-b5a8-92bd45b796b4 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:56:32.370954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1368/2768] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:56:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:56:42.366693 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=26 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:57:11.447736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:57:11.449863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:57:11.597951 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aa606-dbfd-41f1-988d-c9707fcbdbe5 service swift] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:57:11.603200 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652a050-d7d2-47a3-b318-8339f2651333 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:57:11.603805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a050-d7d2-47a3-b318-8339f2651333 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:57:11.604090 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a050-d7d2-47a3-b318-8339f2651333 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:57:11.604383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a050-d7d2-47a3-b318-8339f2651333 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:57:11.606269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-5652a050-d7d2-47a3-b318-8339f2651333 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:57:11.617829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652a050-d7d2-47a3-b318-8339f2651333 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:57:11.619429 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652a050-d7d2-47a3-b318-8339f2651333 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:57:11.629419 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1401/2769] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:57:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:57:19.388041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759634-00ab-4d14-a0c4-5660063c4990 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:57:19.388557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759634-00ab-4d14-a0c4-5660063c4990 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:57:19.388662 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759634-00ab-4d14-a0c4-5660063c4990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:57:19.408220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-13759634-00ab-4d14-a0c4-5660063c4990 None None] MFA Rules not processed for user `03b3ef8c5ddd407f9b1ab952f37f8c62`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:57:19.409405 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-13759634-00ab-4d14-a0c4-5660063c4990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:57:19.416789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1369/2770] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:57:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:57:21.625209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=63 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:57:29.403422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:57:53.715064 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044c52f-1ede-4424-937c-c5c4cac056c0 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:57:53.715534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044c52f-1ede-4424-937c-c5c4cac056c0 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:57:53.715645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044c52f-1ede-4424-937c-c5c4cac056c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:57:53.747218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2044c52f-1ede-4424-937c-c5c4cac056c0 None None] MFA Rules not processed for user `da6017ad9ed5432f91dcb909b72f9a84`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:57:53.748414 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2044c52f-1ede-4424-937c-c5c4cac056c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:57:53.762195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1402/2771] 10.222.0.30 () {58 vars in 967 bytes} [Tue Oct 4 12:57:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:57:53.806876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13759634-00ab-4d14-a0c4-5660063c4990 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:57:53.818530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13759634-00ab-4d14-a0c4-5660063c4990 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:57:53.823365 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc7d2-cd77-4b6f-a196-02435ae27d43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f678debf35484989502439a8780ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:57:53.823982 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc7d2-cd77-4b6f-a196-02435ae27d43 service swift] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:57:53.824258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc7d2-cd77-4b6f-a196-02435ae27d43 service swift] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:57:53.824530 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc7d2-cd77-4b6f-a196-02435ae27d43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:57:53.832250 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcc7d2-cd77-4b6f-a196-02435ae27d43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:57:53.833851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcc7d2-cd77-4b6f-a196-02435ae27d43 service swift] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:57:53.842132 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1370/2772] 10.222.0.30 () {60 vars in 1384 bytes} [Tue Oct 4 12:57:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 12:58:00.318219 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044c52f-1ede-4424-937c-c5c4cac056c0 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:00.405704 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044c52f-1ede-4424-937c-c5c4cac056c0 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:00.410164 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:00.410786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:00.411063 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:00.411331 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] PATH_INFO: `/v3/users/630da4f1316947458d89eef6376e47a4` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:00.412468 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=630da4f1316947458d89eef6376e47a4)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:00.414402 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:00.460226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630da4f1316947458d89eef6376e47a4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.460814 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630da4f1316947458d89eef6376e47a4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.468151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630da4f1316947458d89eef6376e47a4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.468785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630da4f1316947458d89eef6376e47a4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.480762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630da4f1316947458d89eef6376e47a4'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.493202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1403/2773] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:58:00 2022] DELETE /identity/v3/users/630da4f1316947458d89eef6376e47a4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:58:00.662944 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc7d2-cd77-4b6f-a196-02435ae27d43 service swift] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:00.673585 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc7d2-cd77-4b6f-a196-02435ae27d43 service swift] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:00.731976 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:00.732604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:00.732884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:00.733159 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] PATH_INFO: `/v3/projects/5200c817a11d4a998e109af24e5c729b` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:00.734236 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5200c817a11d4a998e109af24e5c729b)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:00.736142 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:00.782479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5200c817a11d4a998e109af24e5c729b', 'request_id': 'req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.788124 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5200c817a11d4a998e109af24e5c729b', 'request_id': 'req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.795539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5200c817a11d4a998e109af24e5c729b', 'request_id': 'req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.818784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] The token cache is being invalidate because project 5200c817a11d4a998e109af24e5c729b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:58:00.819077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.819704 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.823027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1371/2774] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:58:00 2022] DELETE /identity/v3/projects/5200c817a11d4a998e109af24e5c729b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:58:00.826735 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:00.828146 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:00.841541 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac2565-31e1-4902-9388-d43f457fe85b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:00.879426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:58:00.899457 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:00.900666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:00.900945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:00.901243 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] PATH_INFO: `/v3/users/9ecae5ff323a4541ba7eb853419c9495` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:00.902395 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ecae5ff323a4541ba7eb853419c9495)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:00.904302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:00.949888 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ecae5ff323a4541ba7eb853419c9495'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.950536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ecae5ff323a4541ba7eb853419c9495'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.957282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ecae5ff323a4541ba7eb853419c9495'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.957928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ecae5ff323a4541ba7eb853419c9495'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.969977 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-a2431cc5-0546-44f6-9134-6f9f676509a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ecae5ff323a4541ba7eb853419c9495'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:00.982737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1404/2775] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:58:00 2022] DELETE /identity/v3/users/9ecae5ff323a4541ba7eb853419c9495 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:58:01.150437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:01.151878 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:01.167232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a0e99-c45a-4527-bca4-4ff1faf1e25d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:01.224353 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:01.224979 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.225262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.225535 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] PATH_INFO: `/v3/projects/c81b6e3dd9a3484e8fe3684a0bbefd4f` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.226680 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81b6e3dd9a3484e8fe3684a0bbefd4f)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:01.229198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:01.236821 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:58:01.277099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81b6e3dd9a3484e8fe3684a0bbefd4f', 'request_id': 'req-d82c5437-6649-4cbd-8b8d-882cce88d269'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:01.282851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81b6e3dd9a3484e8fe3684a0bbefd4f', 'request_id': 'req-d82c5437-6649-4cbd-8b8d-882cce88d269'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:01.289346 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81b6e3dd9a3484e8fe3684a0bbefd4f', 'request_id': 'req-d82c5437-6649-4cbd-8b8d-882cce88d269'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:01.301156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] The token cache is being invalidate because project c81b6e3dd9a3484e8fe3684a0bbefd4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:58:01.301453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:01.302148 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-d82c5437-6649-4cbd-8b8d-882cce88d269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:58:01.303624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1372/2776] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:58:01 2022] DELETE /identity/v3/projects/c81b6e3dd9a3484e8fe3684a0bbefd4f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:58:01.308653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c17e5-c49b-4e6f-b043-23b26ee93f59 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.308937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c17e5-c49b-4e6f-b043-23b26ee93f59 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.309210 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c17e5-c49b-4e6f-b043-23b26ee93f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.366665 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-ef3c17e5-c49b-4e6f-b043-23b26ee93f59 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:58:01.367879 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-ef3c17e5-c49b-4e6f-b043-23b26ee93f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:01.439868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1405/2777] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:58:01.448338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32277bbb-a9af-4107-906c-009b5cd161dc None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.448637 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32277bbb-a9af-4107-906c-009b5cd161dc None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.448922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32277bbb-a9af-4107-906c-009b5cd161dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.469929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-32277bbb-a9af-4107-906c-009b5cd161dc None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:58:01.470966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-32277bbb-a9af-4107-906c-009b5cd161dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:01.479723 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1373/2778] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:58:01.483906 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c17e5-c49b-4e6f-b043-23b26ee93f59 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:01.494492 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c17e5-c49b-4e6f-b043-23b26ee93f59 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:01.499660 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:01.500449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.500738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.501008 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.501678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:58:01.501988 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:01.503596 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:01.516513 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1406/2779] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:58:01.521190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32277bbb-a9af-4107-906c-009b5cd161dc None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:01.530357 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32277bbb-a9af-4107-906c-009b5cd161dc None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:01.535048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1817-ea6d-4b1a-8a68-dbf3191af8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:01.535645 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1817-ea6d-4b1a-8a68-dbf3191af8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.535925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1817-ea6d-4b1a-8a68-dbf3191af8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.536198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1817-ea6d-4b1a-8a68-dbf3191af8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.536820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1817-ea6d-4b1a-8a68-dbf3191af8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:01.538767 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1817-ea6d-4b1a-8a68-dbf3191af8e3 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:01.566539 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1374/2780] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:58:01 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:58:01.570653 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:01.581213 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54127-7d39-45a9-9a85-12b215346cef admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:01.592700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:58:01.640197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb939-b3ff-4fa1-a088-ad333b07e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:01.640725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb939-b3ff-4fa1-a088-ad333b07e4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.641009 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb939-b3ff-4fa1-a088-ad333b07e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.641283 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fb939-b3ff-4fa1-a088-ad333b07e4f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.642236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fb939-b3ff-4fa1-a088-ad333b07e4f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:01.644147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fb939-b3ff-4fa1-a088-ad333b07e4f1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:01.665049 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1407/2781] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:58:01 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:58:01.669767 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1817-ea6d-4b1a-8a68-dbf3191af8e3 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:01.680383 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1817-ea6d-4b1a-8a68-dbf3191af8e3 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:01.685644 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee451be-884f-48f7-95d2-ce99d3367711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:01.686247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee451be-884f-48f7-95d2-ce99d3367711 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.686531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee451be-884f-48f7-95d2-ce99d3367711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.686803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee451be-884f-48f7-95d2-ce99d3367711 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.687438 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee451be-884f-48f7-95d2-ce99d3367711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:01.689043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee451be-884f-48f7-95d2-ce99d3367711 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:01.699035 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1375/2782] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:58:01.703059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb939-b3ff-4fa1-a088-ad333b07e4f1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:01.713125 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fb939-b3ff-4fa1-a088-ad333b07e4f1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:01.717921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31667d29-62d7-4260-9ad2-d7c1d5fba5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:01.718521 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667d29-62d7-4260-9ad2-d7c1d5fba5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.718802 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667d29-62d7-4260-9ad2-d7c1d5fba5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.719076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667d29-62d7-4260-9ad2-d7c1d5fba5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.719712 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31667d29-62d7-4260-9ad2-d7c1d5fba5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:01.721359 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31667d29-62d7-4260-9ad2-d7c1d5fba5a7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:01.732705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1408/2783] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:58:01.736763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee451be-884f-48f7-95d2-ce99d3367711 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:01.747165 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee451be-884f-48f7-95d2-ce99d3367711 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:01.751747 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:01.752392 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.752673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.752950 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] PATH_INFO: `/v3/projects/26bce8f5d80645e28d56f69efe77773e/users/f5c53dfe621342a2a1f0277625820656/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.767600 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bce8f5d80645e28d56f69efe77773e, user_id=f5c53dfe621342a2a1f0277625820656, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:01.770294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:01.782891 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1376/2784] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:58:01 2022] PUT /identity/v3/projects/26bce8f5d80645e28d56f69efe77773e/users/f5c53dfe621342a2a1f0277625820656/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:58:01.787928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377769-1d45-4a17-8cfd-85f76b1c4604 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.788217 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377769-1d45-4a17-8cfd-85f76b1c4604 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.788487 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17377769-1d45-4a17-8cfd-85f76b1c4604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.808730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-17377769-1d45-4a17-8cfd-85f76b1c4604 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:58:01.809976 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-17377769-1d45-4a17-8cfd-85f76b1c4604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:01.866833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1409/2785] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:58:01.877572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:01.879296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:01.956104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0b7ca-97a5-4768-8d89-9094d2ae198f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:01.959714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b474-62eb-464b-9f6d-614f65b42cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:01.960319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b474-62eb-464b-9f6d-614f65b42cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:01.960601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b474-62eb-464b-9f6d-614f65b42cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:01.960875 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b474-62eb-464b-9f6d-614f65b42cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:01.969748 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b474-62eb-464b-9f6d-614f65b42cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:01.971176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b474-62eb-464b-9f6d-614f65b42cb3 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:01.980942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1377/2786] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 12:58:05.838209 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8a8e-fe02-460d-98a0-0eb63688d22e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:05.838695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8a8e-fe02-460d-98a0-0eb63688d22e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:05.838798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c8a8e-fe02-460d-98a0-0eb63688d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:05.879625 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-113c8a8e-fe02-460d-98a0-0eb63688d22e None None] MFA Rules not processed for user `f5c53dfe621342a2a1f0277625820656`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:58:05.880931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-113c8a8e-fe02-460d-98a0-0eb63688d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:05.959652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1410/2787] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:58:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:58:05.967039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b474-62eb-464b-9f6d-614f65b42cb3 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:05.982919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b474-62eb-464b-9f6d-614f65b42cb3 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:05.990995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ab08-f5e3-4ca0-9e27-dd3b1632a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:05.991968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ab08-f5e3-4ca0-9e27-dd3b1632a731 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:05.992466 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ab08-f5e3-4ca0-9e27-dd3b1632a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:05.992888 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ab08-f5e3-4ca0-9e27-dd3b1632a731 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:05.994390 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ab08-f5e3-4ca0-9e27-dd3b1632a731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:05.998359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ab08-f5e3-4ca0-9e27-dd3b1632a731 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:06.013557 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:58:06.033077 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1378/2788] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:58:05 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:58:06.037448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8a8e-fe02-460d-98a0-0eb63688d22e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:06.049239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c8a8e-fe02-460d-98a0-0eb63688d22e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:06.070863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:58:06.112159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038e96-af33-49e4-9bce-d0f2536d1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:06.112923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038e96-af33-49e4-9bce-d0f2536d1107 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:06.113305 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038e96-af33-49e4-9bce-d0f2536d1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:06.113717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038e96-af33-49e4-9bce-d0f2536d1107 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:06.114466 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd038e96-af33-49e4-9bce-d0f2536d1107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:06.116484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd038e96-af33-49e4-9bce-d0f2536d1107 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:06.140971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1411/2789] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:58:06 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:58:06.145231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ab08-f5e3-4ca0-9e27-dd3b1632a731 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:06.156177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ab08-f5e3-4ca0-9e27-dd3b1632a731 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:06.160959 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaa916-dbe9-4bf7-99e7-bbc1c2b72bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:06.161806 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaa916-dbe9-4bf7-99e7-bbc1c2b72bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:06.162164 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaa916-dbe9-4bf7-99e7-bbc1c2b72bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:06.162529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaa916-dbe9-4bf7-99e7-bbc1c2b72bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:06.163209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eaa916-dbe9-4bf7-99e7-bbc1c2b72bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:06.164838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eaa916-dbe9-4bf7-99e7-bbc1c2b72bf0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:06.176628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1379/2790] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:58:06.181658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038e96-af33-49e4-9bce-d0f2536d1107 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:06.192304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038e96-af33-49e4-9bce-d0f2536d1107 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:06.197277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9786c8b-dd09-46e5-ae7b-b7a58c0e6e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:06.197979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9786c8b-dd09-46e5-ae7b-b7a58c0e6e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:06.198267 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9786c8b-dd09-46e5-ae7b-b7a58c0e6e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:06.198529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9786c8b-dd09-46e5-ae7b-b7a58c0e6e92 admin admin] PATH_INFO: `/v3/projects/d0ea90e14b924b269a1d9c898d116495/users/80d8be00e17c417bac1b6ab479585eff/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:06.215442 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9786c8b-dd09-46e5-ae7b-b7a58c0e6e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ea90e14b924b269a1d9c898d116495, user_id=80d8be00e17c417bac1b6ab479585eff, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:06.218227 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9786c8b-dd09-46e5-ae7b-b7a58c0e6e92 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:06.232937 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1412/2791] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:58:06 2022] PUT /identity/v3/projects/d0ea90e14b924b269a1d9c898d116495/users/80d8be00e17c417bac1b6ab479585eff/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:58:06.236937 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaa916-dbe9-4bf7-99e7-bbc1c2b72bf0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:06.247983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaa916-dbe9-4bf7-99e7-bbc1c2b72bf0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:06.308276 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7f12f-ba29-4c47-becd-0f6ff995607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:06.308894 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7f12f-ba29-4c47-becd-0f6ff995607b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:06.309176 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7f12f-ba29-4c47-becd-0f6ff995607b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:06.309453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7f12f-ba29-4c47-becd-0f6ff995607b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:06.310135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7f12f-ba29-4c47-becd-0f6ff995607b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:06.311750 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7f12f-ba29-4c47-becd-0f6ff995607b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:06.322321 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1380/2792] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:58:06.326508 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9786c8b-dd09-46e5-ae7b-b7a58c0e6e92 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:06.338058 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9786c8b-dd09-46e5-ae7b-b7a58c0e6e92 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:06.342870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:06.343544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:06.343825 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:06.344098 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] PATH_INFO: `/v3/projects/d0ea90e14b924b269a1d9c898d116495/users/80d8be00e17c417bac1b6ab479585eff/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:06.346263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ea90e14b924b269a1d9c898d116495, user_id=80d8be00e17c417bac1b6ab479585eff, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:06.348930 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:06.361178 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1413/2793] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:58:06 2022] PUT /identity/v3/projects/d0ea90e14b924b269a1d9c898d116495/users/80d8be00e17c417bac1b6ab479585eff/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:58:11.136652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefb69-4020-40ff-9e45-2383e7011917 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:11.137177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefb69-4020-40ff-9e45-2383e7011917 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:11.137278 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefb69-4020-40ff-9e45-2383e7011917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:11.166824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4aaefb69-4020-40ff-9e45-2383e7011917 None None] MFA Rules not processed for user `80d8be00e17c417bac1b6ab479585eff`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:58:11.168041 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4aaefb69-4020-40ff-9e45-2383e7011917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:11.242947 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1381/2794] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:58:11.257766 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:11.265393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:11.390603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaabc75-9036-43d2-a4e3-95ea5fb2ea1d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:11.396807 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78593e-5ac9-46e2-be03-5b91c8312ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:11.397425 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78593e-5ac9-46e2-be03-5b91c8312ebe service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:11.397810 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78593e-5ac9-46e2-be03-5b91c8312ebe service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:11.398084 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78593e-5ac9-46e2-be03-5b91c8312ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:11.465936 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:58:11.469694 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78593e-5ac9-46e2-be03-5b91c8312ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:11.478127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78593e-5ac9-46e2-be03-5b91c8312ebe service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:11.495808 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1414/2795] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:58:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:58:12.574813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a518f-d374-4ac1-b335-aa77ce7618be None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:12.575303 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a518f-d374-4ac1-b335-aa77ce7618be None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:12.575416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a518f-d374-4ac1-b335-aa77ce7618be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:12.595789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-ab1a518f-d374-4ac1-b335-aa77ce7618be None None] MFA Rules not processed for user `f5c53dfe621342a2a1f0277625820656`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:58:12.596971 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-ab1a518f-d374-4ac1-b335-aa77ce7618be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:12.614394 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1382/2796] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 12:58:17.193848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f62ee4-6cde-44b7-a7ff-7acd61c1d71a None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:17.194348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f62ee4-6cde-44b7-a7ff-7acd61c1d71a None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:17.194461 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f62ee4-6cde-44b7-a7ff-7acd61c1d71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:17.213659 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-15f62ee4-6cde-44b7-a7ff-7acd61c1d71a None None] MFA Rules not processed for user `03b3ef8c5ddd407f9b1ab952f37f8c62`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:58:17.214843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-15f62ee4-6cde-44b7-a7ff-7acd61c1d71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:58:17.271812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1415/2797] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:58:22.591440 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:INSERT=1,keystone:SELECT=73 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:58:27.264221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=28 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:58:36.421112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a518f-d374-4ac1-b335-aa77ce7618be None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:58:36.474929 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a518f-d374-4ac1-b335-aa77ce7618be None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:58:36.478523 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:58:36.479120 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:58:36.479400 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:58:36.479673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:58:36.488618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:58:36.490081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:58:36.500098 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1383/2798] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:58:46.495255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=26 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:07.110291 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f62ee4-6cde-44b7-a7ff-7acd61c1d71a None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:07.111691 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-15f62ee4-6cde-44b7-a7ff-7acd61c1d71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:07.189234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f62ee4-6cde-44b7-a7ff-7acd61c1d71a None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:07.192858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:07.193463 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:07.193776 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:07.194055 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:07.195777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:07.208964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:07.210424 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:07.221642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1416/2799] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:08.760083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:08.761513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:08.774257 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a649c-149e-4d65-9dd9-75616f5a50e0 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:08.777733 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:08.778322 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:08.778599 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:08.778869 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:08.780635 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:08.793833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:08.795256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:08.805880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1384/2800] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:17.216851 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=35 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:18.801116 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:21.139166 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:21.141113 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:21.216510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12814c1-1a3c-40d7-834d-e11bebe4a259 service cinder] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:21.221184 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:21.222370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:21.222652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:21.222925 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] PATH_INFO: `/v3/users/03b3ef8c5ddd407f9b1ab952f37f8c62` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:21.224128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b3ef8c5ddd407f9b1ab952f37f8c62)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:21.226149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:21.280770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b3ef8c5ddd407f9b1ab952f37f8c62'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.281570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b3ef8c5ddd407f9b1ab952f37f8c62'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.289796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b3ef8c5ddd407f9b1ab952f37f8c62'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.290538 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b3ef8c5ddd407f9b1ab952f37f8c62'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.303348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f9e7f24c-a853-46f4-95c3-4ea27ccf8e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b3ef8c5ddd407f9b1ab952f37f8c62'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.317091 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1417/2801] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:21 2022] DELETE /identity/v3/users/03b3ef8c5ddd407f9b1ab952f37f8c62 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:21.489843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:21.501791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e2984-4dfe-4572-a3d7-61727b199ab4 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:21.560827 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:21.561465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:21.561782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:21.562062 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] PATH_INFO: `/v3/projects/b61b956b9c6a48538a31a0bd82665e7e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:21.563177 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61b956b9c6a48538a31a0bd82665e7e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:21.565137 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:21.618511 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61b956b9c6a48538a31a0bd82665e7e', 'request_id': 'req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.623939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61b956b9c6a48538a31a0bd82665e7e', 'request_id': 'req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.633014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61b956b9c6a48538a31a0bd82665e7e', 'request_id': 'req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.643826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] The token cache is being invalidate because project b61b956b9c6a48538a31a0bd82665e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:21.644708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.645356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-1776ea6c-d8de-4fa5-9fbb-753e1ceb02e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:21.646855 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1385/2802] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:21 2022] DELETE /identity/v3/projects/b61b956b9c6a48538a31a0bd82665e7e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:21.651648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a09da2-72a1-4404-856b-cfb84994cd0d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:21.651926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a09da2-72a1-4404-856b-cfb84994cd0d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:21.652202 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a09da2-72a1-4404-856b-cfb84994cd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:21.672657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-a1a09da2-72a1-4404-856b-cfb84994cd0d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:21.673840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-a1a09da2-72a1-4404-856b-cfb84994cd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:21.731532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1418/2803] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:21.739770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa05fc-f2cd-4159-95f5-2e2aad32a13c None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:21.740058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa05fc-f2cd-4159-95f5-2e2aad32a13c None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:21.740335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa05fc-f2cd-4159-95f5-2e2aad32a13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:21.760208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-c9aa05fc-f2cd-4159-95f5-2e2aad32a13c None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:21.761413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c9aa05fc-f2cd-4159-95f5-2e2aad32a13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:21.769519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1386/2804] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:21.773740 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a09da2-72a1-4404-856b-cfb84994cd0d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:21.783260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a09da2-72a1-4404-856b-cfb84994cd0d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:21.787801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:21.788388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:21.788668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:21.788940 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] PATH_INFO: `/v3/domains` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:21.789582 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88339) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:59:21.789916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:21.791501 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:21.803136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1419/2805] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:59:21.807109 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa05fc-f2cd-4159-95f5-2e2aad32a13c None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:21.816816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa05fc-f2cd-4159-95f5-2e2aad32a13c None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:21.821517 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a888082-2930-4d36-bd80-90ed5b2604f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:21.822146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888082-2930-4d36-bd80-90ed5b2604f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:21.822428 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888082-2930-4d36-bd80-90ed5b2604f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:21.822702 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888082-2930-4d36-bd80-90ed5b2604f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:21.823330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a888082-2930-4d36-bd80-90ed5b2604f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:21.825238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a888082-2930-4d36-bd80-90ed5b2604f0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:21.861085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1387/2806] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:21 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:21.865820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:21.875480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75901272-4419-4d9a-b899-aa1b00e5c80c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:21.879725 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:21.933411 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ff0e9-8049-451e-9bb4-f0bbe4f6e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:21.933980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ff0e9-8049-451e-9bb4-f0bbe4f6e818 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:21.934260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ff0e9-8049-451e-9bb4-f0bbe4f6e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:21.934535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ff0e9-8049-451e-9bb4-f0bbe4f6e818 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:21.935170 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ff0e9-8049-451e-9bb4-f0bbe4f6e818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:21.937088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ff0e9-8049-451e-9bb4-f0bbe4f6e818 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:21.958263 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1420/2807] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:21 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:59:21.962368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a888082-2930-4d36-bd80-90ed5b2604f0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:21.972925 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a888082-2930-4d36-bd80-90ed5b2604f0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:21.977437 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0afe7-ebc7-4463-9403-49da4f21ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:21.978055 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0afe7-ebc7-4463-9403-49da4f21ba45 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:21.978333 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0afe7-ebc7-4463-9403-49da4f21ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:21.978604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0afe7-ebc7-4463-9403-49da4f21ba45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:21.979263 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0afe7-ebc7-4463-9403-49da4f21ba45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:21.980847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0afe7-ebc7-4463-9403-49da4f21ba45 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:21.991190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1388/2808] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:21.995212 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ff0e9-8049-451e-9bb4-f0bbe4f6e818 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.004960 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ff0e9-8049-451e-9bb4-f0bbe4f6e818 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.009490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b14e30-773c-4f2e-8d35-5edbdc5e01d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.010124 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b14e30-773c-4f2e-8d35-5edbdc5e01d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.010388 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b14e30-773c-4f2e-8d35-5edbdc5e01d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.010661 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b14e30-773c-4f2e-8d35-5edbdc5e01d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.011295 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b14e30-773c-4f2e-8d35-5edbdc5e01d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.012869 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b14e30-773c-4f2e-8d35-5edbdc5e01d9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.023636 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1421/2809] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:22.027676 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0afe7-ebc7-4463-9403-49da4f21ba45 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.038104 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0afe7-ebc7-4463-9403-49da4f21ba45 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.042765 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe1db-f2fe-4409-8ed5-f3100bfb875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.043407 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe1db-f2fe-4409-8ed5-f3100bfb875d admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.043688 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe1db-f2fe-4409-8ed5-f3100bfb875d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.043966 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe1db-f2fe-4409-8ed5-f3100bfb875d admin admin] PATH_INFO: `/v3/projects/ed71e32afd2c45019a70956519032a68/users/709ef2523fd147ebb50164a7287d93f3/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.058884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe1db-f2fe-4409-8ed5-f3100bfb875d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed71e32afd2c45019a70956519032a68, user_id=709ef2523fd147ebb50164a7287d93f3, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.061570 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afe1db-f2fe-4409-8ed5-f3100bfb875d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.074345 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1389/2810] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:22 2022] PUT /identity/v3/projects/ed71e32afd2c45019a70956519032a68/users/709ef2523fd147ebb50164a7287d93f3/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:22.084496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4a02-f537-400b-a4cf-cf8bea21219f None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.084785 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4a02-f537-400b-a4cf-cf8bea21219f None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.085066 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4a02-f537-400b-a4cf-cf8bea21219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.113050 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-2b6c4a02-f537-400b-a4cf-cf8bea21219f None None] MFA Rules not processed for user `709ef2523fd147ebb50164a7287d93f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:22.114303 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-2b6c4a02-f537-400b-a4cf-cf8bea21219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:22.177799 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1422/2811] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:22.182292 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe1db-f2fe-4409-8ed5-f3100bfb875d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.201059 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:22.243864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe1db-f2fe-4409-8ed5-f3100bfb875d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.248491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a75806-7f16-4fe2-8c98-c7fb5633e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.249091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a75806-7f16-4fe2-8c98-c7fb5633e75d admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.249371 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a75806-7f16-4fe2-8c98-c7fb5633e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.249671 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a75806-7f16-4fe2-8c98-c7fb5633e75d admin admin] PATH_INFO: `/v3/projects` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.250294 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a75806-7f16-4fe2-8c98-c7fb5633e75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.252196 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a75806-7f16-4fe2-8c98-c7fb5633e75d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.278468 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1390/2812] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:22 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:22.282607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c4a02-f537-400b-a4cf-cf8bea21219f None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.293685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c4a02-f537-400b-a4cf-cf8bea21219f None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.349516 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41295ec5-4d2d-47e2-a0ec-23a3774b3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.350149 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295ec5-4d2d-47e2-a0ec-23a3774b3e99 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.350431 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295ec5-4d2d-47e2-a0ec-23a3774b3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.350705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295ec5-4d2d-47e2-a0ec-23a3774b3e99 admin admin] PATH_INFO: `/v3/users` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.351330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41295ec5-4d2d-47e2-a0ec-23a3774b3e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.353253 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41295ec5-4d2d-47e2-a0ec-23a3774b3e99 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.373770 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1423/2813] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:22 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:59:22.377957 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a75806-7f16-4fe2-8c98-c7fb5633e75d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.388223 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a75806-7f16-4fe2-8c98-c7fb5633e75d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.393134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120944a4-dc89-4817-85c4-e30b708744fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.394304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120944a4-dc89-4817-85c4-e30b708744fd admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.394588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120944a4-dc89-4817-85c4-e30b708744fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.394862 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120944a4-dc89-4817-85c4-e30b708744fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.395499 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120944a4-dc89-4817-85c4-e30b708744fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.397100 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120944a4-dc89-4817-85c4-e30b708744fd admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.407601 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1391/2814] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:22.412205 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41295ec5-4d2d-47e2-a0ec-23a3774b3e99 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.418544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:22.422630 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41295ec5-4d2d-47e2-a0ec-23a3774b3e99 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.428297 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e563-99b8-41a3-a1dd-488f9239fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.428998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e563-99b8-41a3-a1dd-488f9239fa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.429279 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e563-99b8-41a3-a1dd-488f9239fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.429553 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e563-99b8-41a3-a1dd-488f9239fa33 admin admin] PATH_INFO: `/v3/projects/d435e652048c4cdc9ebdcf4f1b09e191/users/b93f5b57db7a4a43a28b76f4392bd482/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.444104 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129e563-99b8-41a3-a1dd-488f9239fa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d435e652048c4cdc9ebdcf4f1b09e191, user_id=b93f5b57db7a4a43a28b76f4392bd482, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.446780 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129e563-99b8-41a3-a1dd-488f9239fa33 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.459927 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1424/2815] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:22 2022] PUT /identity/v3/projects/d435e652048c4cdc9ebdcf4f1b09e191/users/b93f5b57db7a4a43a28b76f4392bd482/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:22.463807 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120944a4-dc89-4817-85c4-e30b708744fd admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.474624 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120944a4-dc89-4817-85c4-e30b708744fd admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.531860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0106e-a150-4595-bf3c-248f5bfef2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.532516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0106e-a150-4595-bf3c-248f5bfef2ac admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.532736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0106e-a150-4595-bf3c-248f5bfef2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.533014 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0106e-a150-4595-bf3c-248f5bfef2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.533682 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0106e-a150-4595-bf3c-248f5bfef2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.535884 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0106e-a150-4595-bf3c-248f5bfef2ac admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.545494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1392/2816] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:22.549645 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e563-99b8-41a3-a1dd-488f9239fa33 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.559652 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e563-99b8-41a3-a1dd-488f9239fa33 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.564226 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.564866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.565151 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.565445 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] PATH_INFO: `/v3/projects/d435e652048c4cdc9ebdcf4f1b09e191/users/b93f5b57db7a4a43a28b76f4392bd482/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.567399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d435e652048c4cdc9ebdcf4f1b09e191, user_id=b93f5b57db7a4a43a28b76f4392bd482, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.570067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.579934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1425/2817] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:22 2022] PUT /identity/v3/projects/d435e652048c4cdc9ebdcf4f1b09e191/users/b93f5b57db7a4a43a28b76f4392bd482/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:22.592024 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc3f10-46f2-4f06-aa84-88fc61a37f65 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.592306 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc3f10-46f2-4f06-aa84-88fc61a37f65 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.592587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc3f10-46f2-4f06-aa84-88fc61a37f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.621335 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7ebc3f10-46f2-4f06-aa84-88fc61a37f65 None None] MFA Rules not processed for user `b93f5b57db7a4a43a28b76f4392bd482`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:22.622578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7ebc3f10-46f2-4f06-aa84-88fc61a37f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:22.688652 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1393/2818] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:22.700211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.701931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:22.758840 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc4c4c-4e96-45d0-a16d-e84718a22e14 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.762398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e033-0b87-476d-8fe5-1693defdbff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.762991 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e033-0b87-476d-8fe5-1693defdbff1 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.763301 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e033-0b87-476d-8fe5-1693defdbff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.763574 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e033-0b87-476d-8fe5-1693defdbff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.773269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e033-0b87-476d-8fe5-1693defdbff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.774724 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e033-0b87-476d-8fe5-1693defdbff1 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.783903 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1426/2819] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:22.849742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc3f10-46f2-4f06-aa84-88fc61a37f65 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:22.863376 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:22.911939 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc3f10-46f2-4f06-aa84-88fc61a37f65 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:22.916725 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:22.917359 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:22.917664 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:22.917946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] PATH_INFO: `/v3/users/709ef2523fd147ebb50164a7287d93f3` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:22.919082 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] RBAC: Authorizing `identity:delete_user(user_id=709ef2523fd147ebb50164a7287d93f3)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:22.921015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:22.968256 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709ef2523fd147ebb50164a7287d93f3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:22.968917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709ef2523fd147ebb50164a7287d93f3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:22.978225 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709ef2523fd147ebb50164a7287d93f3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:22.978863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709ef2523fd147ebb50164a7287d93f3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:22.986102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709ef2523fd147ebb50164a7287d93f3'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.005465 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1394/2820] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:22 2022] DELETE /identity/v3/users/709ef2523fd147ebb50164a7287d93f3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:23.010532 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae9cb6-8536-4763-a617-2cecc452ff53 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:23.010746 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae9cb6-8536-4763-a617-2cecc452ff53 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:23.011019 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae9cb6-8536-4763-a617-2cecc452ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:23.030255 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-4eae9cb6-8536-4763-a617-2cecc452ff53 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:23.031472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4eae9cb6-8536-4763-a617-2cecc452ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:23.089589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1427/2821] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:23.099983 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:23.101547 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:23.158667 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1beb8-a249-475c-92cf-83f9e8cb353d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:23.162910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14cb3-16bf-49a8-92b6-1514fe0f9d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:23.163522 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14cb3-16bf-49a8-92b6-1514fe0f9d38 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:23.163803 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14cb3-16bf-49a8-92b6-1514fe0f9d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:23.164079 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d14cb3-16bf-49a8-92b6-1514fe0f9d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:23.172857 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d14cb3-16bf-49a8-92b6-1514fe0f9d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:23.174339 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d14cb3-16bf-49a8-92b6-1514fe0f9d38 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:23.184174 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1395/2822] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:23.453338 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae9cb6-8536-4763-a617-2cecc452ff53 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:23.454920 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-4eae9cb6-8536-4763-a617-2cecc452ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:23.469093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae9cb6-8536-4763-a617-2cecc452ff53 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:23.474197 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:23.474843 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:23.475105 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:23.475370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] PATH_INFO: `/v3/projects/ed71e32afd2c45019a70956519032a68` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:23.476476 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed71e32afd2c45019a70956519032a68)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:23.478446 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:23.529526 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed71e32afd2c45019a70956519032a68', 'request_id': 'req-f908e944-794d-4ec4-8325-ded71ce81f4a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.535506 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed71e32afd2c45019a70956519032a68', 'request_id': 'req-f908e944-794d-4ec4-8325-ded71ce81f4a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.541613 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed71e32afd2c45019a70956519032a68', 'request_id': 'req-f908e944-794d-4ec4-8325-ded71ce81f4a'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.544143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:23.555913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] The token cache is being invalidate because project ed71e32afd2c45019a70956519032a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:23.556208 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.556837 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.558382 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1428/2823] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:23 2022] DELETE /identity/v3/projects/ed71e32afd2c45019a70956519032a68 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:59:23.562389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14cb3-16bf-49a8-92b6-1514fe0f9d38 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:23.571791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d14cb3-16bf-49a8-92b6-1514fe0f9d38 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:23.603687 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:23.635724 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:23.636356 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:23.636641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:23.636917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] PATH_INFO: `/v3/users/b93f5b57db7a4a43a28b76f4392bd482` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:23.638063 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93f5b57db7a4a43a28b76f4392bd482)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:23.639990 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:23.684844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93f5b57db7a4a43a28b76f4392bd482'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.685493 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93f5b57db7a4a43a28b76f4392bd482'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.692586 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93f5b57db7a4a43a28b76f4392bd482'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.693213 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93f5b57db7a4a43a28b76f4392bd482'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.700003 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-85d53fb4-0dd7-4f8a-af4e-30efaaef3724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93f5b57db7a4a43a28b76f4392bd482'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:23.716938 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1396/2824] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:23 2022] DELETE /identity/v3/users/b93f5b57db7a4a43a28b76f4392bd482 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:23.984711 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:23.986189 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:24.001293 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908e944-794d-4ec4-8325-ded71ce81f4a admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.057474 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.058353 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.058646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.058921 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] PATH_INFO: `/v3/projects/d435e652048c4cdc9ebdcf4f1b09e191` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.060042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d435e652048c4cdc9ebdcf4f1b09e191)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.062082 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.107015 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd435e652048c4cdc9ebdcf4f1b09e191', 'request_id': 'req-cb079f02-cacd-4623-a919-81dc8408a040'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:24.112877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd435e652048c4cdc9ebdcf4f1b09e191', 'request_id': 'req-cb079f02-cacd-4623-a919-81dc8408a040'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:24.118958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd435e652048c4cdc9ebdcf4f1b09e191', 'request_id': 'req-cb079f02-cacd-4623-a919-81dc8408a040'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:24.132868 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] The token cache is being invalidate because project d435e652048c4cdc9ebdcf4f1b09e191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:24.133242 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:24.133944 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-cb079f02-cacd-4623-a919-81dc8408a040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:24.135417 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1429/2825] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:23 2022] DELETE /identity/v3/projects/d435e652048c4cdc9ebdcf4f1b09e191 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:24.140253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30129-9280-4bf5-970e-6500c1b32e7a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.140527 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30129-9280-4bf5-970e-6500c1b32e7a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.141066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab30129-9280-4bf5-970e-6500c1b32e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.160247 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-8ab30129-9280-4bf5-970e-6500c1b32e7a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:24.161442 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-8ab30129-9280-4bf5-970e-6500c1b32e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:24.218486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1397/2826] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:24.226705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb8ebd-cfb8-42a9-8328-28df3b076d80 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.227024 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb8ebd-cfb8-42a9-8328-28df3b076d80 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.227304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb8ebd-cfb8-42a9-8328-28df3b076d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.247451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bbfb8ebd-cfb8-42a9-8328-28df3b076d80 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:24.248646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bbfb8ebd-cfb8-42a9-8328-28df3b076d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:24.256547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1430/2827] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:24.260816 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab30129-9280-4bf5-970e-6500c1b32e7a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.270918 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab30129-9280-4bf5-970e-6500c1b32e7a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.275616 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.276218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.276504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.276779 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.277420 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:59:24.277767 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.279370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.291329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1398/2828] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:59:24.295554 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb8ebd-cfb8-42a9-8328-28df3b076d80 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.305294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb8ebd-cfb8-42a9-8328-28df3b076d80 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.309817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6bafe-c3d2-4765-ab1e-bdf20cbf3faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.310399 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bafe-c3d2-4765-ab1e-bdf20cbf3faa admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.310678 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bafe-c3d2-4765-ab1e-bdf20cbf3faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.310943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6bafe-c3d2-4765-ab1e-bdf20cbf3faa admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.311568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6bafe-c3d2-4765-ab1e-bdf20cbf3faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.313527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6bafe-c3d2-4765-ab1e-bdf20cbf3faa admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.340036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1431/2829] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:24 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:24.344350 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.356314 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4615c7-6df1-41a6-952c-c233caf54344 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.396258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:24.415638 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd102-d3a4-4b6a-9b97-6d95df0d8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.416253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd102-d3a4-4b6a-9b97-6d95df0d8ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.416536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd102-d3a4-4b6a-9b97-6d95df0d8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.416814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bd102-d3a4-4b6a-9b97-6d95df0d8ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.417446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bd102-d3a4-4b6a-9b97-6d95df0d8ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.419410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bd102-d3a4-4b6a-9b97-6d95df0d8ad7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.441033 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1399/2830] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:24 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:24.445314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6bafe-c3d2-4765-ab1e-bdf20cbf3faa admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.455558 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6bafe-c3d2-4765-ab1e-bdf20cbf3faa admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.460199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7be95-346f-406a-9d8b-d7e71f5ed5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.460790 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7be95-346f-406a-9d8b-d7e71f5ed5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.461069 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7be95-346f-406a-9d8b-d7e71f5ed5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.461341 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7be95-346f-406a-9d8b-d7e71f5ed5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.462014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7be95-346f-406a-9d8b-d7e71f5ed5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.463604 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7be95-346f-406a-9d8b-d7e71f5ed5c2 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.473831 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1432/2831] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:24.477782 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd102-d3a4-4b6a-9b97-6d95df0d8ad7 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.488011 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bd102-d3a4-4b6a-9b97-6d95df0d8ad7 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.492591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4f9d7-d0be-4ba3-a78d-0add74739922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.493180 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f9d7-d0be-4ba3-a78d-0add74739922 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.493457 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f9d7-d0be-4ba3-a78d-0add74739922 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.493769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f9d7-d0be-4ba3-a78d-0add74739922 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.494399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4f9d7-d0be-4ba3-a78d-0add74739922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.495981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4f9d7-d0be-4ba3-a78d-0add74739922 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.508027 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1400/2832] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:24.512367 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7be95-346f-406a-9d8b-d7e71f5ed5c2 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.523078 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7be95-346f-406a-9d8b-d7e71f5ed5c2 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.527732 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e798f27-feda-479f-90fd-713e649aabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.528383 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e798f27-feda-479f-90fd-713e649aabcb admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.528666 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e798f27-feda-479f-90fd-713e649aabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.528942 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e798f27-feda-479f-90fd-713e649aabcb admin admin] PATH_INFO: `/v3/projects/df085acb11e74e6c8306d06e6b2ffebc/users/56cbc812fcb94a4e8604d900aae3003c/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.543370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e798f27-feda-479f-90fd-713e649aabcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df085acb11e74e6c8306d06e6b2ffebc, user_id=56cbc812fcb94a4e8604d900aae3003c, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.546045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e798f27-feda-479f-90fd-713e649aabcb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.559313 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1433/2833] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:24 2022] PUT /identity/v3/projects/df085acb11e74e6c8306d06e6b2ffebc/users/56cbc812fcb94a4e8604d900aae3003c/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:24.570689 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f736e-72ed-4539-9c71-4d43bce3d791 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.571158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f736e-72ed-4539-9c71-4d43bce3d791 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.571158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f736e-72ed-4539-9c71-4d43bce3d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.598590 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-449f736e-72ed-4539-9c71-4d43bce3d791 None None] MFA Rules not processed for user `56cbc812fcb94a4e8604d900aae3003c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:24.599776 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-449f736e-72ed-4539-9c71-4d43bce3d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:24.663430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1401/2834] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:24.667883 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e798f27-feda-479f-90fd-713e649aabcb admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.688772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:24.729848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e798f27-feda-479f-90fd-713e649aabcb admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.734444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8ba83-2a13-467c-83a4-8a2beab12da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.735044 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8ba83-2a13-467c-83a4-8a2beab12da7 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.735330 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8ba83-2a13-467c-83a4-8a2beab12da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.735606 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8ba83-2a13-467c-83a4-8a2beab12da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.736241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8ba83-2a13-467c-83a4-8a2beab12da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.738690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8ba83-2a13-467c-83a4-8a2beab12da7 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.764161 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1434/2835] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:24 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:24.768538 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f736e-72ed-4539-9c71-4d43bce3d791 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.779231 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f736e-72ed-4539-9c71-4d43bce3d791 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.834240 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089a2f-afd8-48ef-80a2-98b2848df9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.834775 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089a2f-afd8-48ef-80a2-98b2848df9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.835058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089a2f-afd8-48ef-80a2-98b2848df9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.835334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089a2f-afd8-48ef-80a2-98b2848df9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.835952 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32089a2f-afd8-48ef-80a2-98b2848df9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.837895 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32089a2f-afd8-48ef-80a2-98b2848df9a6 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.858399 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1402/2836] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:24 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:59:24.862982 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8ba83-2a13-467c-83a4-8a2beab12da7 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.873426 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8ba83-2a13-467c-83a4-8a2beab12da7 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.878062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ff55c-7b96-45f9-9a85-f145bab8b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.879156 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff55c-7b96-45f9-9a85-f145bab8b58d admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.879454 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff55c-7b96-45f9-9a85-f145bab8b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.879752 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff55c-7b96-45f9-9a85-f145bab8b58d admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.880522 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ff55c-7b96-45f9-9a85-f145bab8b58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.882241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ff55c-7b96-45f9-9a85-f145bab8b58d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.892841 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1435/2837] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:24.896846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089a2f-afd8-48ef-80a2-98b2848df9a6 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.906641 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089a2f-afd8-48ef-80a2-98b2848df9a6 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:24.911230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f49e-93a9-408b-80c3-f45152ce6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:24.911872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f49e-93a9-408b-80c3-f45152ce6915 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:24.912248 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f49e-93a9-408b-80c3-f45152ce6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:24.912526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f49e-93a9-408b-80c3-f45152ce6915 admin admin] PATH_INFO: `/v3/projects/0637fe10295542d1b35465f5d1064939/users/eb4dc807c29d43fd9d3ad8a2035ced59/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:24.927323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71f49e-93a9-408b-80c3-f45152ce6915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0637fe10295542d1b35465f5d1064939, user_id=eb4dc807c29d43fd9d3ad8a2035ced59, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:24.930092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71f49e-93a9-408b-80c3-f45152ce6915 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:24.943156 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1403/2838] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:24 2022] PUT /identity/v3/projects/0637fe10295542d1b35465f5d1064939/users/eb4dc807c29d43fd9d3ad8a2035ced59/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:24.947211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ff55c-7b96-45f9-9a85-f145bab8b58d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:24.957117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ff55c-7b96-45f9-9a85-f145bab8b58d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:25.012495 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b08f2-e1e7-4353-ba69-d0eee010cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:25.013112 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b08f2-e1e7-4353-ba69-d0eee010cb3b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:25.013379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b08f2-e1e7-4353-ba69-d0eee010cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:25.013690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b08f2-e1e7-4353-ba69-d0eee010cb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:25.014324 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b08f2-e1e7-4353-ba69-d0eee010cb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:25.016177 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b08f2-e1e7-4353-ba69-d0eee010cb3b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:25.025715 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1436/2839] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:25.029865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f49e-93a9-408b-80c3-f45152ce6915 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:25.040630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f49e-93a9-408b-80c3-f45152ce6915 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:25.045152 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:25.045832 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:25.046112 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:25.046385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] PATH_INFO: `/v3/projects/0637fe10295542d1b35465f5d1064939/users/eb4dc807c29d43fd9d3ad8a2035ced59/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:25.048296 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0637fe10295542d1b35465f5d1064939, user_id=eb4dc807c29d43fd9d3ad8a2035ced59, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:25.051589 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:25.061449 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1404/2840] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:25 2022] PUT /identity/v3/projects/0637fe10295542d1b35465f5d1064939/users/eb4dc807c29d43fd9d3ad8a2035ced59/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:25.072668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b719-11b4-4762-8c19-7a95df1189be None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:25.072958 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b719-11b4-4762-8c19-7a95df1189be None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:25.073238 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b719-11b4-4762-8c19-7a95df1189be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:25.101731 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-6b45b719-11b4-4762-8c19-7a95df1189be None None] MFA Rules not processed for user `eb4dc807c29d43fd9d3ad8a2035ced59`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:25.102943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6b45b719-11b4-4762-8c19-7a95df1189be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:25.169646 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1437/2841] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:25.180763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:25.182516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:25.187761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:25.240078 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ba5b6-3266-4b26-b908-44fe08bd36ce admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:25.243709 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5da2-c89d-4ed1-8d9b-574a16beb220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:25.244304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5da2-c89d-4ed1-8d9b-574a16beb220 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:25.244591 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5da2-c89d-4ed1-8d9b-574a16beb220 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:25.244863 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5da2-c89d-4ed1-8d9b-574a16beb220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:25.253631 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f5da2-c89d-4ed1-8d9b-574a16beb220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:25.255158 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f5da2-c89d-4ed1-8d9b-574a16beb220 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:25.264330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1405/2842] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:25 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:25.311311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b719-11b4-4762-8c19-7a95df1189be None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:25.312684 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-6b45b719-11b4-4762-8c19-7a95df1189be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:25.324393 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b719-11b4-4762-8c19-7a95df1189be None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:25.327955 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86e2be-1206-4c7d-8d8c-cad9ee01ff3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:25.328547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e2be-1206-4c7d-8d8c-cad9ee01ff3d service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:25.328827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e2be-1206-4c7d-8d8c-cad9ee01ff3d service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:25.329099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e2be-1206-4c7d-8d8c-cad9ee01ff3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:25.341618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:25.386455 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86e2be-1206-4c7d-8d8c-cad9ee01ff3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:25.387817 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86e2be-1206-4c7d-8d8c-cad9ee01ff3d service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:25.397260 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1438/2843] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:28.665334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5da2-c89d-4ed1-8d9b-574a16beb220 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:28.729182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5da2-c89d-4ed1-8d9b-574a16beb220 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:28.733622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:28.734282 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:28.734545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:28.734820 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] PATH_INFO: `/v3/users/56cbc812fcb94a4e8604d900aae3003c` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:28.735924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56cbc812fcb94a4e8604d900aae3003c)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:28.737942 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:28.783287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56cbc812fcb94a4e8604d900aae3003c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:28.784009 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56cbc812fcb94a4e8604d900aae3003c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:28.791192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56cbc812fcb94a4e8604d900aae3003c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:28.791897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56cbc812fcb94a4e8604d900aae3003c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:28.798737 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56cbc812fcb94a4e8604d900aae3003c'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:28.816038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1406/2844] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:28 2022] DELETE /identity/v3/users/56cbc812fcb94a4e8604d900aae3003c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:28.820544 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a0255-8cb7-4af3-987b-eb553f17e7c9 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:28.821039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a0255-8cb7-4af3-987b-eb553f17e7c9 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:28.821144 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a0255-8cb7-4af3-987b-eb553f17e7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:28.840996 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-988a0255-8cb7-4af3-987b-eb553f17e7c9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:28.842221 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-988a0255-8cb7-4af3-987b-eb553f17e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:28.899577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1439/2845] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:28.909293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:28.911281 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:28.939080 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:28.970105 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237fd3-26b9-44e7-abbe-ed86c8f39f37 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:28.973848 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6890e-63d3-4100-8269-695de0511292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:28.974458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6890e-63d3-4100-8269-695de0511292 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:28.974742 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6890e-63d3-4100-8269-695de0511292 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:28.975015 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6890e-63d3-4100-8269-695de0511292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:28.983851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6890e-63d3-4100-8269-695de0511292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:28.985227 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6890e-63d3-4100-8269-695de0511292 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:28.994564 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1407/2846] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:29.264040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a0255-8cb7-4af3-987b-eb553f17e7c9 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:29.265499 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-988a0255-8cb7-4af3-987b-eb553f17e7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:29.277935 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a0255-8cb7-4af3-987b-eb553f17e7c9 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:29.282945 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:29.283581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:29.283859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:29.284128 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] PATH_INFO: `/v3/projects/df085acb11e74e6c8306d06e6b2ffebc` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:29.285690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df085acb11e74e6c8306d06e6b2ffebc)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:29.288348 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:29.334572 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df085acb11e74e6c8306d06e6b2ffebc', 'request_id': 'req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.339987 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df085acb11e74e6c8306d06e6b2ffebc', 'request_id': 'req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.346030 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df085acb11e74e6c8306d06e6b2ffebc', 'request_id': 'req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.358256 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] The token cache is being invalidate because project df085acb11e74e6c8306d06e6b2ffebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:29.358540 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.359155 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.360722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1440/2847] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:29 2022] DELETE /identity/v3/projects/df085acb11e74e6c8306d06e6b2ffebc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:29.365253 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6890e-63d3-4100-8269-695de0511292 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:29.374838 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6890e-63d3-4100-8269-695de0511292 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:29.431550 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:29.432182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:29.432462 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:29.432735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] PATH_INFO: `/v3/users/eb4dc807c29d43fd9d3ad8a2035ced59` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:29.433910 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4dc807c29d43fd9d3ad8a2035ced59)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:29.435867 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:29.480313 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4dc807c29d43fd9d3ad8a2035ced59'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.480956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4dc807c29d43fd9d3ad8a2035ced59'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.488385 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4dc807c29d43fd9d3ad8a2035ced59'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.489634 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4dc807c29d43fd9d3ad8a2035ced59'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.496289 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-357703ee-4639-4636-9b63-849e5cea1ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4dc807c29d43fd9d3ad8a2035ced59'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.514500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1408/2848] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:29 2022] DELETE /identity/v3/users/eb4dc807c29d43fd9d3ad8a2035ced59 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:29.795901 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:29.797552 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:29.813360 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe490db-e1d2-4404-bc1c-c8e39c9ea8f6 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:29.847829 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:29.872452 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:29.873081 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:29.873358 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:29.873656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] PATH_INFO: `/v3/projects/0637fe10295542d1b35465f5d1064939` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:29.874757 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0637fe10295542d1b35465f5d1064939)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:29.876642 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:29.921859 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0637fe10295542d1b35465f5d1064939', 'request_id': 'req-d92c0126-22f7-4e54-843f-cc57ccd78d52'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.927530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0637fe10295542d1b35465f5d1064939', 'request_id': 'req-d92c0126-22f7-4e54-843f-cc57ccd78d52'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.933702 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0637fe10295542d1b35465f5d1064939', 'request_id': 'req-d92c0126-22f7-4e54-843f-cc57ccd78d52'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.946531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] The token cache is being invalidate because project 0637fe10295542d1b35465f5d1064939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:29.946824 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.947458 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-d92c0126-22f7-4e54-843f-cc57ccd78d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:29.948971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1441/2849] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:29 2022] DELETE /identity/v3/projects/0637fe10295542d1b35465f5d1064939 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:29.953919 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9010b7d-ad77-45d9-9c69-1c9453340a4e None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:29.954395 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9010b7d-ad77-45d9-9c69-1c9453340a4e None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:29.954495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9010b7d-ad77-45d9-9c69-1c9453340a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:29.974766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-a9010b7d-ad77-45d9-9c69-1c9453340a4e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:29.975954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-a9010b7d-ad77-45d9-9c69-1c9453340a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:30.016329 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:30.034922 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1409/2850] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:30.043304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31442b1b-9aa3-4278-ba25-7ab140a1e54e None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.043527 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31442b1b-9aa3-4278-ba25-7ab140a1e54e None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.043798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31442b1b-9aa3-4278-ba25-7ab140a1e54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.062916 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-31442b1b-9aa3-4278-ba25-7ab140a1e54e None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:30.064093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-31442b1b-9aa3-4278-ba25-7ab140a1e54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:30.071772 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1442/2851] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:30.075843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9010b7d-ad77-45d9-9c69-1c9453340a4e None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.086013 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9010b7d-ad77-45d9-9c69-1c9453340a4e None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.090619 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.091214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.091496 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.091773 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.092412 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:59:30.092718 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.094362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.106374 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1410/2852] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:59:30.110249 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31442b1b-9aa3-4278-ba25-7ab140a1e54e None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.119153 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31442b1b-9aa3-4278-ba25-7ab140a1e54e None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.123718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff40a-994d-4ab1-bfc2-7be24250d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.124302 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff40a-994d-4ab1-bfc2-7be24250d6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.124578 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff40a-994d-4ab1-bfc2-7be24250d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.124842 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff40a-994d-4ab1-bfc2-7be24250d6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.125473 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ff40a-994d-4ab1-bfc2-7be24250d6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.127398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ff40a-994d-4ab1-bfc2-7be24250d6c9 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.154797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1443/2853] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:30 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:30.158819 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.169307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4495e5-1b23-4956-b133-2d3f78f31b7d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.229097 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf9d3-4d9b-41fd-9ef3-d7e50a74406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.229770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf9d3-4d9b-41fd-9ef3-d7e50a74406d admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.230058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf9d3-4d9b-41fd-9ef3-d7e50a74406d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.230337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf9d3-4d9b-41fd-9ef3-d7e50a74406d admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.230972 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf9d3-4d9b-41fd-9ef3-d7e50a74406d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.232899 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdf9d3-4d9b-41fd-9ef3-d7e50a74406d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.253243 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1411/2854] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:30 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:59:30.258088 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff40a-994d-4ab1-bfc2-7be24250d6c9 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.268333 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff40a-994d-4ab1-bfc2-7be24250d6c9 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.273471 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a1aa-d9ec-4244-902c-ec442104fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.274094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a1aa-d9ec-4244-902c-ec442104fdeb admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.274377 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a1aa-d9ec-4244-902c-ec442104fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.274648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a1aa-d9ec-4244-902c-ec442104fdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.275281 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a1aa-d9ec-4244-902c-ec442104fdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.276866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a1aa-d9ec-4244-902c-ec442104fdeb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.286496 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1444/2855] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:30.290187 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf9d3-4d9b-41fd-9ef3-d7e50a74406d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.300446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdf9d3-4d9b-41fd-9ef3-d7e50a74406d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.305058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9552885-9585-4079-b259-2c9fa34ba44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.305685 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9552885-9585-4079-b259-2c9fa34ba44b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.305973 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9552885-9585-4079-b259-2c9fa34ba44b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.306249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9552885-9585-4079-b259-2c9fa34ba44b admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.306893 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9552885-9585-4079-b259-2c9fa34ba44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.308486 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9552885-9585-4079-b259-2c9fa34ba44b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.319477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1412/2856] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:30.323462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a1aa-d9ec-4244-902c-ec442104fdeb admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.333748 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a1aa-d9ec-4244-902c-ec442104fdeb admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.338397 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105ec86-e92e-4f5f-ad4b-b09a0f948b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.339035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105ec86-e92e-4f5f-ad4b-b09a0f948b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.339317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105ec86-e92e-4f5f-ad4b-b09a0f948b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.339589 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105ec86-e92e-4f5f-ad4b-b09a0f948b1c admin admin] PATH_INFO: `/v3/projects/caadf5b53c334eee80b00fd57471c48d/users/88052b46be0146ac9a4c9d9056e84e51/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.353892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105ec86-e92e-4f5f-ad4b-b09a0f948b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=caadf5b53c334eee80b00fd57471c48d, user_id=88052b46be0146ac9a4c9d9056e84e51, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.356534 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105ec86-e92e-4f5f-ad4b-b09a0f948b1c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.368931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1445/2857] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:30 2022] PUT /identity/v3/projects/caadf5b53c334eee80b00fd57471c48d/users/88052b46be0146ac9a4c9d9056e84e51/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:59:30.379584 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2f76-8a2c-4628-b731-b850d0f2bf2d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.379870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2f76-8a2c-4628-b731-b850d0f2bf2d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.380146 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2f76-8a2c-4628-b731-b850d0f2bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.408311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-4aef2f76-8a2c-4628-b731-b850d0f2bf2d None None] MFA Rules not processed for user `88052b46be0146ac9a4c9d9056e84e51`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:30.409515 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-4aef2f76-8a2c-4628-b731-b850d0f2bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:30.472323 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1413/2858] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:30.476820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105ec86-e92e-4f5f-ad4b-b09a0f948b1c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.536612 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105ec86-e92e-4f5f-ad4b-b09a0f948b1c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.541284 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294432a-29ea-4ef8-8c11-58b23f9f4714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.541919 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294432a-29ea-4ef8-8c11-58b23f9f4714 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.542206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294432a-29ea-4ef8-8c11-58b23f9f4714 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.542481 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294432a-29ea-4ef8-8c11-58b23f9f4714 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.543103 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294432a-29ea-4ef8-8c11-58b23f9f4714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.545017 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294432a-29ea-4ef8-8c11-58b23f9f4714 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.554756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:30.573060 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1446/2859] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:30 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:30.577277 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2f76-8a2c-4628-b731-b850d0f2bf2d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.587785 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2f76-8a2c-4628-b731-b850d0f2bf2d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.630161 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:30.647480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02747d-72ce-45d2-909f-d153b1426f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.648089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02747d-72ce-45d2-909f-d153b1426f5a admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.648369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02747d-72ce-45d2-909f-d153b1426f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.648640 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02747d-72ce-45d2-909f-d153b1426f5a admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.649261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02747d-72ce-45d2-909f-d153b1426f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.651208 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02747d-72ce-45d2-909f-d153b1426f5a admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.671464 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1414/2860] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:30 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:30.675423 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294432a-29ea-4ef8-8c11-58b23f9f4714 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.686076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294432a-29ea-4ef8-8c11-58b23f9f4714 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.690811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b63e3-4a23-41b3-9174-03b99515b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.691413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b63e3-4a23-41b3-9174-03b99515b54b admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.692241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b63e3-4a23-41b3-9174-03b99515b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.692515 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b63e3-4a23-41b3-9174-03b99515b54b admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.693150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b63e3-4a23-41b3-9174-03b99515b54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.694786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b63e3-4a23-41b3-9174-03b99515b54b admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.704591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1447/2861] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:30.708656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02747d-72ce-45d2-909f-d153b1426f5a admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.718370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02747d-72ce-45d2-909f-d153b1426f5a admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.723032 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374444-3e48-4ee4-8b65-a4a93b296001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.723710 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374444-3e48-4ee4-8b65-a4a93b296001 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.723989 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374444-3e48-4ee4-8b65-a4a93b296001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.724261 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374444-3e48-4ee4-8b65-a4a93b296001 admin admin] PATH_INFO: `/v3/projects/c081c41add57497eab908501ecc2155f/users/ebef91a38d694ab88f82262d14b78c8e/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.738924 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e374444-3e48-4ee4-8b65-a4a93b296001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c081c41add57497eab908501ecc2155f, user_id=ebef91a38d694ab88f82262d14b78c8e, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.741572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e374444-3e48-4ee4-8b65-a4a93b296001 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.753791 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1415/2862] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:30 2022] PUT /identity/v3/projects/c081c41add57497eab908501ecc2155f/users/ebef91a38d694ab88f82262d14b78c8e/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:30.758321 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b63e3-4a23-41b3-9174-03b99515b54b admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.768350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b63e3-4a23-41b3-9174-03b99515b54b admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.824039 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dca847-e577-4d8f-b5b8-085af72f1c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.824577 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca847-e577-4d8f-b5b8-085af72f1c1e admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.824860 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca847-e577-4d8f-b5b8-085af72f1c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.825134 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dca847-e577-4d8f-b5b8-085af72f1c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.825812 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dca847-e577-4d8f-b5b8-085af72f1c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.827415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dca847-e577-4d8f-b5b8-085af72f1c1e admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.837115 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1448/2863] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 12:59:30.841254 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374444-3e48-4ee4-8b65-a4a93b296001 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:30.851479 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374444-3e48-4ee4-8b65-a4a93b296001 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:30.856057 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:30.856708 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.856996 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.857275 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] PATH_INFO: `/v3/projects/c081c41add57497eab908501ecc2155f/users/ebef91a38d694ab88f82262d14b78c8e/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.859258 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c081c41add57497eab908501ecc2155f, user_id=ebef91a38d694ab88f82262d14b78c8e, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:30.861956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:30.872491 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1416/2864] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:30 2022] PUT /identity/v3/projects/c081c41add57497eab908501ecc2155f/users/ebef91a38d694ab88f82262d14b78c8e/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:30.936629 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8841-faac-4ace-bd93-1248ff082ff5 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:30.937215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8841-faac-4ace-bd93-1248ff082ff5 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:30.937215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8841-faac-4ace-bd93-1248ff082ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:30.965491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-42ac8841-faac-4ace-bd93-1248ff082ff5 None None] MFA Rules not processed for user `ebef91a38d694ab88f82262d14b78c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:30.966722 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-42ac8841-faac-4ace-bd93-1248ff082ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:31.033789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1449/2865] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:31.045038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:31.046847 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:31.104410 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9604d-529a-47f2-ab31-1080ad93bb23 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:31.108205 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a47c94-d856-4422-b6b8-0bbdbb074bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:31.108814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47c94-d856-4422-b6b8-0bbdbb074bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:31.109099 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47c94-d856-4422-b6b8-0bbdbb074bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:31.109368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a47c94-d856-4422-b6b8-0bbdbb074bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:31.119245 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a47c94-d856-4422-b6b8-0bbdbb074bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:31.120696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a47c94-d856-4422-b6b8-0bbdbb074bb4 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:31.130049 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1417/2866] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:31.232858 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8841-faac-4ace-bd93-1248ff082ff5 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:31.243051 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8841-faac-4ace-bd93-1248ff082ff5 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:31.246599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585fbf-7cca-487a-811c-b3dcd92c191f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:31.247199 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585fbf-7cca-487a-811c-b3dcd92c191f service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:31.247480 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585fbf-7cca-487a-811c-b3dcd92c191f service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:31.247758 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585fbf-7cca-487a-811c-b3dcd92c191f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:31.303676 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f585fbf-7cca-487a-811c-b3dcd92c191f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:31.305100 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f585fbf-7cca-487a-811c-b3dcd92c191f service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:31.308531 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:31.315328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1450/2867] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:33.899815 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a47c94-d856-4422-b6b8-0bbdbb074bb4 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:33.960876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a47c94-d856-4422-b6b8-0bbdbb074bb4 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:33.965319 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:33.965961 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:33.966246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:33.966516 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] PATH_INFO: `/v3/users/88052b46be0146ac9a4c9d9056e84e51` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:33.967608 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=88052b46be0146ac9a4c9d9056e84e51)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:33.969525 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:34.008675 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:34.015425 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88052b46be0146ac9a4c9d9056e84e51'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.016450 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88052b46be0146ac9a4c9d9056e84e51'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.023946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88052b46be0146ac9a4c9d9056e84e51'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.024610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88052b46be0146ac9a4c9d9056e84e51'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.031574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88052b46be0146ac9a4c9d9056e84e51'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.048045 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1418/2868] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:33 2022] DELETE /identity/v3/users/88052b46be0146ac9a4c9d9056e84e51 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:34.052517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf43a1-ce18-493f-b291-d5f34c3864f7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:34.053020 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf43a1-ce18-493f-b291-d5f34c3864f7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:34.053121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf43a1-ce18-493f-b291-d5f34c3864f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:34.071913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bfcf43a1-ce18-493f-b291-d5f34c3864f7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:34.073086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bfcf43a1-ce18-493f-b291-d5f34c3864f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:34.128591 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1451/2869] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:34.139058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:34.140480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:34.197865 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ec588-8dfa-4afb-8422-0d83bc15d86d admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:34.201513 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fc421-f943-4d5c-8436-f11ed4cc17c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:34.202147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc421-f943-4d5c-8436-f11ed4cc17c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:34.202429 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc421-f943-4d5c-8436-f11ed4cc17c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:34.202706 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc421-f943-4d5c-8436-f11ed4cc17c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:34.212209 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fc421-f943-4d5c-8436-f11ed4cc17c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:34.213679 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fc421-f943-4d5c-8436-f11ed4cc17c8 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:34.222995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1419/2870] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:34.487601 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf43a1-ce18-493f-b291-d5f34c3864f7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:34.489127 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bfcf43a1-ce18-493f-b291-d5f34c3864f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:34.501222 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf43a1-ce18-493f-b291-d5f34c3864f7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:34.505855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:34.506490 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:34.506773 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:34.507045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] PATH_INFO: `/v3/projects/caadf5b53c334eee80b00fd57471c48d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:34.508172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caadf5b53c334eee80b00fd57471c48d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:34.510130 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:34.557706 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caadf5b53c334eee80b00fd57471c48d', 'request_id': 'req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.563300 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caadf5b53c334eee80b00fd57471c48d', 'request_id': 'req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.569528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caadf5b53c334eee80b00fd57471c48d', 'request_id': 'req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.581981 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] The token cache is being invalidate because project caadf5b53c334eee80b00fd57471c48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:34.582796 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.583433 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.584913 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1452/2871] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:34 2022] DELETE /identity/v3/projects/caadf5b53c334eee80b00fd57471c48d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:34.589000 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fc421-f943-4d5c-8436-f11ed4cc17c8 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:34.599230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fc421-f943-4d5c-8436-f11ed4cc17c8 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:34.654831 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:34.655460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:34.655736 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:34.656008 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] PATH_INFO: `/v3/users/ebef91a38d694ab88f82262d14b78c8e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:34.657117 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebef91a38d694ab88f82262d14b78c8e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:34.659083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:34.705898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebef91a38d694ab88f82262d14b78c8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.706544 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebef91a38d694ab88f82262d14b78c8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.714639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebef91a38d694ab88f82262d14b78c8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.715566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebef91a38d694ab88f82262d14b78c8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.721048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:34.723214 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-67875003-1d08-4c4a-b09a-06e54697548d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebef91a38d694ab88f82262d14b78c8e'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:34.742081 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1420/2872] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:34 2022] DELETE /identity/v3/users/ebef91a38d694ab88f82262d14b78c8e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:35.005404 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.006882 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:35.022174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3169cf6-2bbb-48a6-80b0-e5423cc23de8 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.077668 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.078314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.078559 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.078827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] PATH_INFO: `/v3/projects/c081c41add57497eab908501ecc2155f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.079923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c081c41add57497eab908501ecc2155f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.081838 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.104954 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:35.127384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c081c41add57497eab908501ecc2155f', 'request_id': 'req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:35.133695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c081c41add57497eab908501ecc2155f', 'request_id': 'req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:35.140304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c081c41add57497eab908501ecc2155f', 'request_id': 'req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:35.152316 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] The token cache is being invalidate because project c081c41add57497eab908501ecc2155f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:35.152602 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:35.153218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-6f4a131c-08d5-4a99-bbf4-6d65f94aedea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:35.154717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1453/2873] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:35 2022] DELETE /identity/v3/projects/c081c41add57497eab908501ecc2155f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:35.159611 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc18e4-b6af-4083-89da-5588696e2ecf None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.160106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc18e4-b6af-4083-89da-5588696e2ecf None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.160238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc18e4-b6af-4083-89da-5588696e2ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.180128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-fdfc18e4-b6af-4083-89da-5588696e2ecf None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:35.181363 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fdfc18e4-b6af-4083-89da-5588696e2ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:35.239307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1421/2874] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:35.246918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a536d-fde7-4fc1-a4bd-030108255cbd None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.247211 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a536d-fde7-4fc1-a4bd-030108255cbd None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.247488 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a536d-fde7-4fc1-a4bd-030108255cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.267887 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-453a536d-fde7-4fc1-a4bd-030108255cbd None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:35.269110 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-453a536d-fde7-4fc1-a4bd-030108255cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:35.277022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1454/2875] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:35.280902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc18e4-b6af-4083-89da-5588696e2ecf None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.290378 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc18e4-b6af-4083-89da-5588696e2ecf None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.294975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.295568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.295852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.296128 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.296766 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:59:35.297068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.298745 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.310519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1422/2876] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:59:35.314815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a536d-fde7-4fc1-a4bd-030108255cbd None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.324633 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a536d-fde7-4fc1-a4bd-030108255cbd None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.329844 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3793900-180e-4c6b-8208-94a49edeb156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.330528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793900-180e-4c6b-8208-94a49edeb156 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.330870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793900-180e-4c6b-8208-94a49edeb156 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.331236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3793900-180e-4c6b-8208-94a49edeb156 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.332117 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3793900-180e-4c6b-8208-94a49edeb156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.334736 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3793900-180e-4c6b-8208-94a49edeb156 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.362148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1455/2877] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:35 2022] POST /identity/v3/projects => generated 407 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:35.366673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.376419 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf7c04-8441-47a5-b0c2-7d1e4bd61f0b admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.433868 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6297a86-332f-40c5-a26c-ddf97f972b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.434480 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6297a86-332f-40c5-a26c-ddf97f972b8e admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.434763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6297a86-332f-40c5-a26c-ddf97f972b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.435038 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6297a86-332f-40c5-a26c-ddf97f972b8e admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.435670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6297a86-332f-40c5-a26c-ddf97f972b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.437618 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6297a86-332f-40c5-a26c-ddf97f972b8e admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.457926 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1423/2878] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:35 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:35.462147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3793900-180e-4c6b-8208-94a49edeb156 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.472097 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3793900-180e-4c6b-8208-94a49edeb156 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.477094 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17bdfe-9264-4876-9d55-1d23694265f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.477717 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17bdfe-9264-4876-9d55-1d23694265f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.477998 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17bdfe-9264-4876-9d55-1d23694265f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.478269 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17bdfe-9264-4876-9d55-1d23694265f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.478918 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17bdfe-9264-4876-9d55-1d23694265f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.480507 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17bdfe-9264-4876-9d55-1d23694265f1 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.490771 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1456/2879] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:35.494505 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6297a86-332f-40c5-a26c-ddf97f972b8e admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.504540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6297a86-332f-40c5-a26c-ddf97f972b8e admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.509160 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae422476-21ac-4312-9b19-6d23d4d42988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.509795 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422476-21ac-4312-9b19-6d23d4d42988 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.510084 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422476-21ac-4312-9b19-6d23d4d42988 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.510361 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422476-21ac-4312-9b19-6d23d4d42988 admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.510997 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae422476-21ac-4312-9b19-6d23d4d42988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.512735 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae422476-21ac-4312-9b19-6d23d4d42988 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.523770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1424/2880] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:35.527783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17bdfe-9264-4876-9d55-1d23694265f1 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.538245 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17bdfe-9264-4876-9d55-1d23694265f1 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.543045 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a1c7e-4b74-4839-b61b-e8f1851550fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.543730 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1c7e-4b74-4839-b61b-e8f1851550fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.544014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1c7e-4b74-4839-b61b-e8f1851550fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.544315 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1c7e-4b74-4839-b61b-e8f1851550fb admin admin] PATH_INFO: `/v3/projects/62574b2fec2242b48ce82cbb1ee2514d/users/08fd4048ac404b6cb2ada8f831cc2699/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.560462 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a1c7e-4b74-4839-b61b-e8f1851550fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62574b2fec2242b48ce82cbb1ee2514d, user_id=08fd4048ac404b6cb2ada8f831cc2699, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.563159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a1c7e-4b74-4839-b61b-e8f1851550fb admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.575820 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1457/2881] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:35 2022] PUT /identity/v3/projects/62574b2fec2242b48ce82cbb1ee2514d/users/08fd4048ac404b6cb2ada8f831cc2699/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:35.587338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdfc8-03db-4e58-9f3c-78ea66bb5bf5 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.587628 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdfc8-03db-4e58-9f3c-78ea66bb5bf5 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.587906 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdfc8-03db-4e58-9f3c-78ea66bb5bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.616025 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-77dfdfc8-03db-4e58-9f3c-78ea66bb5bf5 None None] MFA Rules not processed for user `08fd4048ac404b6cb2ada8f831cc2699`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:35.617164 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-77dfdfc8-03db-4e58-9f3c-78ea66bb5bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:35.649828 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:35.683800 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1425/2882] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:35.688350 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a1c7e-4b74-4839-b61b-e8f1851550fb admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.748080 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a1c7e-4b74-4839-b61b-e8f1851550fb admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.752697 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9707-6873-4c1c-926c-b9f54e4edf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.753294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9707-6873-4c1c-926c-b9f54e4edf06 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.753576 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9707-6873-4c1c-926c-b9f54e4edf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.753880 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9707-6873-4c1c-926c-b9f54e4edf06 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.754512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d9707-6873-4c1c-926c-b9f54e4edf06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.756413 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d9707-6873-4c1c-926c-b9f54e4edf06 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.781895 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1458/2883] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:35 2022] POST /identity/v3/projects => generated 407 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:35.786546 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdfc8-03db-4e58-9f3c-78ea66bb5bf5 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.796953 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdfc8-03db-4e58-9f3c-78ea66bb5bf5 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.851424 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32828569-f8b1-461c-8e86-659d05f34a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.852043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32828569-f8b1-461c-8e86-659d05f34a56 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.852304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32828569-f8b1-461c-8e86-659d05f34a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.852577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32828569-f8b1-461c-8e86-659d05f34a56 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.853199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32828569-f8b1-461c-8e86-659d05f34a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.855135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32828569-f8b1-461c-8e86-659d05f34a56 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.875330 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1426/2884] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:35 2022] POST /identity/v3/users => generated 310 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:59:35.879286 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9707-6873-4c1c-926c-b9f54e4edf06 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.889472 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9707-6873-4c1c-926c-b9f54e4edf06 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.894550 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0224a-71d1-4db4-9098-6ebaaf3709fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.895657 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0224a-71d1-4db4-9098-6ebaaf3709fd admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.895941 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0224a-71d1-4db4-9098-6ebaaf3709fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.896215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0224a-71d1-4db4-9098-6ebaaf3709fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.896857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0224a-71d1-4db4-9098-6ebaaf3709fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.898494 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0224a-71d1-4db4-9098-6ebaaf3709fd admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.908923 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1459/2885] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:35.913529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32828569-f8b1-461c-8e86-659d05f34a56 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.923417 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32828569-f8b1-461c-8e86-659d05f34a56 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.928574 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b08d1-fefd-4925-8fa6-9b95f3fd13b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:35.929224 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b08d1-fefd-4925-8fa6-9b95f3fd13b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:35.929534 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b08d1-fefd-4925-8fa6-9b95f3fd13b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:35.929844 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b08d1-fefd-4925-8fa6-9b95f3fd13b0 admin admin] PATH_INFO: `/v3/projects/49085ecb3053445aa69fd63d931d245f/users/dae113ac42604462b9169a1462b9fecf/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:35.944833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b08d1-fefd-4925-8fa6-9b95f3fd13b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49085ecb3053445aa69fd63d931d245f, user_id=dae113ac42604462b9169a1462b9fecf, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:35.947563 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b08d1-fefd-4925-8fa6-9b95f3fd13b0 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:35.960956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1427/2886] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:35 2022] PUT /identity/v3/projects/49085ecb3053445aa69fd63d931d245f/users/dae113ac42604462b9169a1462b9fecf/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:35.964892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0224a-71d1-4db4-9098-6ebaaf3709fd admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:35.975581 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0224a-71d1-4db4-9098-6ebaaf3709fd admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:35.993865 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:36.034514 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dbc21-eb93-4be7-b3db-c3a4018c7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:36.035121 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbc21-eb93-4be7-b3db-c3a4018c7da4 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:36.035934 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbc21-eb93-4be7-b3db-c3a4018c7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:36.036218 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbc21-eb93-4be7-b3db-c3a4018c7da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:36.036853 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dbc21-eb93-4be7-b3db-c3a4018c7da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:36.038497 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dbc21-eb93-4be7-b3db-c3a4018c7da4 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:36.048364 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1460/2887] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:36.052608 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b08d1-fefd-4925-8fa6-9b95f3fd13b0 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:36.062843 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b08d1-fefd-4925-8fa6-9b95f3fd13b0 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:36.067408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:36.068050 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:36.068331 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:36.068606 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] PATH_INFO: `/v3/projects/49085ecb3053445aa69fd63d931d245f/users/dae113ac42604462b9169a1462b9fecf/roles/b8bf66974c0448089a192ead432a35f2` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:36.070540 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49085ecb3053445aa69fd63d931d245f, user_id=dae113ac42604462b9169a1462b9fecf, role_id=b8bf66974c0448089a192ead432a35f2)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:36.073199 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:36.083854 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1428/2888] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:36 2022] PUT /identity/v3/projects/49085ecb3053445aa69fd63d931d245f/users/dae113ac42604462b9169a1462b9fecf/roles/b8bf66974c0448089a192ead432a35f2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:36.093791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51907b86-d582-4db7-8d93-6cf398138c12 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:36.094294 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51907b86-d582-4db7-8d93-6cf398138c12 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:36.094407 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51907b86-d582-4db7-8d93-6cf398138c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:36.122450 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-51907b86-d582-4db7-8d93-6cf398138c12 None None] MFA Rules not processed for user `dae113ac42604462b9169a1462b9fecf`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:36.123656 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-51907b86-d582-4db7-8d93-6cf398138c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:36.192014 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1461/2889] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:36.202348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:36.204039 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:36.259195 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e711bc-7e14-461c-b50b-e92de30f43e4 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:36.262760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a3f46-93c4-4229-b1ca-4ef92d9f2900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:36.263349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a3f46-93c4-4229-b1ca-4ef92d9f2900 service cinder] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:36.263626 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a3f46-93c4-4229-b1ca-4ef92d9f2900 service cinder] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:36.263897 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a3f46-93c4-4229-b1ca-4ef92d9f2900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:36.273299 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a3f46-93c4-4229-b1ca-4ef92d9f2900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:36.274752 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a3f46-93c4-4229-b1ca-4ef92d9f2900 service cinder] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:36.283740 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1429/2890] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:36.428067 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51907b86-d582-4db7-8d93-6cf398138c12 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:36.437833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51907b86-d582-4db7-8d93-6cf398138c12 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:36.441349 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242816f-1ca1-43b8-8d8e-8bfcd1471e02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:36.442535 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242816f-1ca1-43b8-8d8e-8bfcd1471e02 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:36.442764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242816f-1ca1-43b8-8d8e-8bfcd1471e02 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:36.443036 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242816f-1ca1-43b8-8d8e-8bfcd1471e02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:36.497737 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242816f-1ca1-43b8-8d8e-8bfcd1471e02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:36.499169 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242816f-1ca1-43b8-8d8e-8bfcd1471e02 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:36.509092 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1462/2891] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:41.751529 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a3f46-93c4-4229-b1ca-4ef92d9f2900 service cinder] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:41.782504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:41.814233 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a3f46-93c4-4229-b1ca-4ef92d9f2900 service cinder] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:41.819422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:41.820048 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:41.820332 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:41.820610 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] PATH_INFO: `/v3/users/08fd4048ac404b6cb2ada8f831cc2699` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:41.821772 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fd4048ac404b6cb2ada8f831cc2699)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:41.823696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:41.868764 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fd4048ac404b6cb2ada8f831cc2699'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:41.869406 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fd4048ac404b6cb2ada8f831cc2699'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:41.876813 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fd4048ac404b6cb2ada8f831cc2699'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:41.877447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fd4048ac404b6cb2ada8f831cc2699'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:41.884907 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fd4048ac404b6cb2ada8f831cc2699'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:41.902334 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1430/2892] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:41 2022] DELETE /identity/v3/users/08fd4048ac404b6cb2ada8f831cc2699 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:41.906876 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f993-22e4-4cd0-be5f-8ea202d80116 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:41.907380 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f993-22e4-4cd0-be5f-8ea202d80116 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:41.907510 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087f993-22e4-4cd0-be5f-8ea202d80116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:41.926086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-d087f993-22e4-4cd0-be5f-8ea202d80116 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:41.927794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d087f993-22e4-4cd0-be5f-8ea202d80116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:41.964607 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=100 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:41.984928 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1463/2893] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:41.995058 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:41.996398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:42.051612 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8a3d7-ae44-4fe8-a26e-257b0b8337fe admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:42.055751 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed74e-bc45-44b3-ac00-019b6ddf13fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:42.056354 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed74e-bc45-44b3-ac00-019b6ddf13fe service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:42.056630 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed74e-bc45-44b3-ac00-019b6ddf13fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:42.056902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed74e-bc45-44b3-ac00-019b6ddf13fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:42.065663 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ed74e-bc45-44b3-ac00-019b6ddf13fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:42.067092 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ed74e-bc45-44b3-ac00-019b6ddf13fe service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:42.076804 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1431/2894] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:42.347234 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f993-22e4-4cd0-be5f-8ea202d80116 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:42.348801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-d087f993-22e4-4cd0-be5f-8ea202d80116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:42.361236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087f993-22e4-4cd0-be5f-8ea202d80116 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:42.366314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:42.366948 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:42.367225 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:42.367494 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] PATH_INFO: `/v3/projects/62574b2fec2242b48ce82cbb1ee2514d` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:42.368599 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62574b2fec2242b48ce82cbb1ee2514d)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:42.370533 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:42.432801 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62574b2fec2242b48ce82cbb1ee2514d', 'request_id': 'req-23c7d589-5bd6-4d18-82e2-779708c39a96'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.439370 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62574b2fec2242b48ce82cbb1ee2514d', 'request_id': 'req-23c7d589-5bd6-4d18-82e2-779708c39a96'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.446400 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62574b2fec2242b48ce82cbb1ee2514d', 'request_id': 'req-23c7d589-5bd6-4d18-82e2-779708c39a96'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.461742 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] The token cache is being invalidate because project 62574b2fec2242b48ce82cbb1ee2514d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:42.462309 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.462969 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.464511 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1464/2895] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:42 2022] DELETE /identity/v3/projects/62574b2fec2242b48ce82cbb1ee2514d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:42.468743 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed74e-bc45-44b3-ac00-019b6ddf13fe service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:42.479577 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed74e-bc45-44b3-ac00-019b6ddf13fe service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:42.530145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:42.541871 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:42.542504 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:42.542781 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:42.543056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] PATH_INFO: `/v3/users/dae113ac42604462b9169a1462b9fecf` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:42.544193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae113ac42604462b9169a1462b9fecf)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:42.546252 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:42.590846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae113ac42604462b9169a1462b9fecf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.591494 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae113ac42604462b9169a1462b9fecf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.598951 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae113ac42604462b9169a1462b9fecf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.600202 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae113ac42604462b9169a1462b9fecf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.606974 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c5e0528a-a0be-4c2e-a5d4-26e1fc8067f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae113ac42604462b9169a1462b9fecf'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:42.623846 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1432/2896] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:42 2022] DELETE /identity/v3/users/dae113ac42604462b9169a1462b9fecf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:42.891172 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:42.892643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:42.909133 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7d589-5bd6-4d18-82e2-779708c39a96 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:42.965148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:42.965811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:42.966095 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:42.966372 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] PATH_INFO: `/v3/projects/49085ecb3053445aa69fd63d931d245f` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:42.967491 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49085ecb3053445aa69fd63d931d245f)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:42.969438 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.014643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49085ecb3053445aa69fd63d931d245f', 'request_id': 'req-b38fa827-b445-4933-96ef-b5e2605e2de0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.020667 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49085ecb3053445aa69fd63d931d245f', 'request_id': 'req-b38fa827-b445-4933-96ef-b5e2605e2de0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.027306 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49085ecb3053445aa69fd63d931d245f', 'request_id': 'req-b38fa827-b445-4933-96ef-b5e2605e2de0'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.030870 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:43.042140 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] The token cache is being invalidate because project 49085ecb3053445aa69fd63d931d245f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:43.042440 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.043120 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-b38fa827-b445-4933-96ef-b5e2605e2de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.044587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1465/2897] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:42 2022] DELETE /identity/v3/projects/49085ecb3053445aa69fd63d931d245f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:43.049447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55f274-1266-4eff-8417-a3d28320c8a9 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.049946 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55f274-1266-4eff-8417-a3d28320c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.050043 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55f274-1266-4eff-8417-a3d28320c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.069625 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-7f55f274-1266-4eff-8417-a3d28320c8a9 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:43.070769 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-7f55f274-1266-4eff-8417-a3d28320c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:43.129073 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1433/2898] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:43.137783 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07593df-cc6a-48ec-a7a4-7a4fd9e89513 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.138107 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07593df-cc6a-48ec-a7a4-7a4fd9e89513 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.138405 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07593df-cc6a-48ec-a7a4-7a4fd9e89513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.158856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-c07593df-cc6a-48ec-a7a4-7a4fd9e89513 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:43.160062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-c07593df-cc6a-48ec-a7a4-7a4fd9e89513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:43.168451 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1466/2899] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:43.172802 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55f274-1266-4eff-8417-a3d28320c8a9 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.183070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55f274-1266-4eff-8417-a3d28320c8a9 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:43.187572 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:43.188167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.188447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.188730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.189373 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:59:43.189712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:43.191307 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.202860 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1434/2900] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:59:43.207062 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07593df-cc6a-48ec-a7a4-7a4fd9e89513 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.216157 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07593df-cc6a-48ec-a7a4-7a4fd9e89513 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:43.220823 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b2ab2-9b02-4805-98a3-40c73a200b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:43.221412 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2ab2-9b02-4805-98a3-40c73a200b33 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.221756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2ab2-9b02-4805-98a3-40c73a200b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.222035 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2ab2-9b02-4805-98a3-40c73a200b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.222695 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2ab2-9b02-4805-98a3-40c73a200b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:43.225150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2ab2-9b02-4805-98a3-40c73a200b33 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.252099 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1467/2901] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:43 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 12:59:43.256167 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.266293 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba1188-66c4-4a35-a141-8d5b9847338f admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:43.315761 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:43.322853 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16fa65-f467-4111-8de1-d90682fa0ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:43.323475 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16fa65-f467-4111-8de1-d90682fa0ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.323768 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16fa65-f467-4111-8de1-d90682fa0ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.324228 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16fa65-f467-4111-8de1-d90682fa0ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.324917 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16fa65-f467-4111-8de1-d90682fa0ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:43.327192 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16fa65-f467-4111-8de1-d90682fa0ca9 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.348135 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1435/2902] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:43 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:43.352847 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b2ab2-9b02-4805-98a3-40c73a200b33 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.362896 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b2ab2-9b02-4805-98a3-40c73a200b33 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:43.367484 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3940b-9f4b-4868-bc01-7a5edfcaafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:43.368076 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3940b-9f4b-4868-bc01-7a5edfcaafe5 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.368356 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3940b-9f4b-4868-bc01-7a5edfcaafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.368626 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3940b-9f4b-4868-bc01-7a5edfcaafe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.369259 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3940b-9f4b-4868-bc01-7a5edfcaafe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:43.370894 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3940b-9f4b-4868-bc01-7a5edfcaafe5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.380658 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1468/2903] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:43.384580 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16fa65-f467-4111-8de1-d90682fa0ca9 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.394588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16fa65-f467-4111-8de1-d90682fa0ca9 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:43.399712 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d39df3-8be5-4f43-aa54-aa994bf34fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:43.400297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d39df3-8be5-4f43-aa54-aa994bf34fda admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.400578 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d39df3-8be5-4f43-aa54-aa994bf34fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.400852 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d39df3-8be5-4f43-aa54-aa994bf34fda admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.401510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d39df3-8be5-4f43-aa54-aa994bf34fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:43.403130 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d39df3-8be5-4f43-aa54-aa994bf34fda admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.414126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1436/2904] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:43.418520 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3940b-9f4b-4868-bc01-7a5edfcaafe5 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.431374 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3940b-9f4b-4868-bc01-7a5edfcaafe5 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:43.436139 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:43.436794 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.437081 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.437359 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] PATH_INFO: `/v3/projects/d84c226689194dfa9952f4baeb615363/users/a7c95ec4773d4c97b23224e18fc0fc44/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.451609 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84c226689194dfa9952f4baeb615363, user_id=a7c95ec4773d4c97b23224e18fc0fc44, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:43.454317 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.467410 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1469/2905] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:43 2022] PUT /identity/v3/projects/d84c226689194dfa9952f4baeb615363/users/a7c95ec4773d4c97b23224e18fc0fc44/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:59:43.479222 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ce54-ba6b-40fb-986a-d4a6094f880f None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.479510 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ce54-ba6b-40fb-986a-d4a6094f880f None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.479786 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857ce54-ba6b-40fb-986a-d4a6094f880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.506898 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-f857ce54-ba6b-40fb-986a-d4a6094f880f None None] MFA Rules not processed for user `a7c95ec4773d4c97b23224e18fc0fc44`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:43.508220 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-f857ce54-ba6b-40fb-986a-d4a6094f880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:43.571255 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1437/2906] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:43.582152 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.584342 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:43.642548 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c995f-4e64-4921-9960-6c2ddfc9ea3d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:43.646738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d14e-478e-490f-9fd0-cf4295e9eec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd75de5eca91b46daaffd3bd79b69a6d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:43.647339 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d14e-478e-490f-9fd0-cf4295e9eec9 service cinder] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.647618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d14e-478e-490f-9fd0-cf4295e9eec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.647892 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d14e-478e-490f-9fd0-cf4295e9eec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.656093 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d14e-478e-490f-9fd0-cf4295e9eec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:43.657528 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d14e-478e-490f-9fd0-cf4295e9eec9 service cinder] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.666769 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1470/2907] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:43.691716 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857ce54-ba6b-40fb-986a-d4a6094f880f None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.752362 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857ce54-ba6b-40fb-986a-d4a6094f880f None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:43.756902 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:43.757519 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.757833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.758106 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] PATH_INFO: `/v3/users/a7c95ec4773d4c97b23224e18fc0fc44` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.759216 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c95ec4773d4c97b23224e18fc0fc44)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:43.761138 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:43.808531 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c95ec4773d4c97b23224e18fc0fc44'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.809232 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c95ec4773d4c97b23224e18fc0fc44'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.815789 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c95ec4773d4c97b23224e18fc0fc44'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.816500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c95ec4773d4c97b23224e18fc0fc44'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.823430 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c95ec4773d4c97b23224e18fc0fc44'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:43.827883 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:43.843083 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1438/2908] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:43 2022] DELETE /identity/v3/users/a7c95ec4773d4c97b23224e18fc0fc44 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:43.847571 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e89c1-c70f-408b-b9be-f4fa1eec743d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:43.847863 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e89c1-c70f-408b-b9be-f4fa1eec743d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:43.848142 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e89c1-c70f-408b-b9be-f4fa1eec743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:43.868334 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-b10e89c1-c70f-408b-b9be-f4fa1eec743d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:43.869529 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b10e89c1-c70f-408b-b9be-f4fa1eec743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:43.926546 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1471/2909] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:43.937170 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:43.938604 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:43.997271 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8831e-0b34-4775-b085-28aa31898921 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.000956 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be15fcb-eeb9-4016-8b74-8d55c1731f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.001566 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15fcb-eeb9-4016-8b74-8d55c1731f75 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.001876 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15fcb-eeb9-4016-8b74-8d55c1731f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.002151 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15fcb-eeb9-4016-8b74-8d55c1731f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.011304 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be15fcb-eeb9-4016-8b74-8d55c1731f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.012754 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be15fcb-eeb9-4016-8b74-8d55c1731f75 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:44.022756 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1439/2910] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:44.286449 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e89c1-c70f-408b-b9be-f4fa1eec743d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:44.288587 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-b10e89c1-c70f-408b-b9be-f4fa1eec743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:44.303148 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e89c1-c70f-408b-b9be-f4fa1eec743d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.308059 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.308698 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.308980 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.309833 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] PATH_INFO: `/v3/projects/d84c226689194dfa9952f4baeb615363` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.311277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84c226689194dfa9952f4baeb615363)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.313206 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:44.347637 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:44.362566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84c226689194dfa9952f4baeb615363', 'request_id': 'req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:44.367931 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84c226689194dfa9952f4baeb615363', 'request_id': 'req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:44.374136 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84c226689194dfa9952f4baeb615363', 'request_id': 'req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:44.387584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] The token cache is being invalidate because project d84c226689194dfa9952f4baeb615363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:44.387877 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:44.388517 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-bd35e730-1d78-4ff5-bbfc-5768b1948ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:44.390026 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1472/2911] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:44 2022] DELETE /identity/v3/projects/d84c226689194dfa9952f4baeb615363 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:44.395191 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e4be5-d7ac-429a-ae4b-2b5683e4328a None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.395633 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e4be5-d7ac-429a-ae4b-2b5683e4328a None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.395730 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e4be5-d7ac-429a-ae4b-2b5683e4328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.415771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-2f8e4be5-d7ac-429a-ae4b-2b5683e4328a None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:44.417018 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-2f8e4be5-d7ac-429a-ae4b-2b5683e4328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:44.475198 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1440/2912] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:44.482791 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43407c-014a-4609-ae2d-e3d7c451ac9d None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.483150 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43407c-014a-4609-ae2d-e3d7c451ac9d None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.483498 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43407c-014a-4609-ae2d-e3d7c451ac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.502797 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-bc43407c-014a-4609-ae2d-e3d7c451ac9d None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:44.503986 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-bc43407c-014a-4609-ae2d-e3d7c451ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:44.512326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1473/2913] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:44.516536 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e4be5-d7ac-429a-ae4b-2b5683e4328a None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:44.526595 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e4be5-d7ac-429a-ae4b-2b5683e4328a None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.531103 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.531696 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.531975 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.532249 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] PATH_INFO: `/v3/domains` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.532886 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 12:59:44.533190 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.534810 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:44.546090 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1441/2914] 10.222.0.30 () {58 vars in 1153 bytes} [Tue Oct 4 12:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 12:59:44.550378 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43407c-014a-4609-ae2d-e3d7c451ac9d None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:44.559420 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43407c-014a-4609-ae2d-e3d7c451ac9d None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.564029 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8586-798f-4519-8467-7e576a18d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.564622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8586-798f-4519-8467-7e576a18d844 admin admin] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.564904 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8586-798f-4519-8467-7e576a18d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.565174 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8586-798f-4519-8467-7e576a18d844 admin admin] PATH_INFO: `/v3/projects` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.565827 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b8586-798f-4519-8467-7e576a18d844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.568223 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b8586-798f-4519-8467-7e576a18d844 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:44.595718 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1474/2915] 10.222.0.30 () {60 vars in 1153 bytes} [Tue Oct 4 12:59:44 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:44.599833 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:44.609873 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1b39-8c82-46ef-9ea7-12f094272205 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.664763 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745147-81ba-430d-ada8-c29d0451e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.665287 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745147-81ba-430d-ada8-c29d0451e2de admin admin] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.665568 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745147-81ba-430d-ada8-c29d0451e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.665872 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745147-81ba-430d-ada8-c29d0451e2de admin admin] PATH_INFO: `/v3/users` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.666489 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07745147-81ba-430d-ada8-c29d0451e2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.668416 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07745147-81ba-430d-ada8-c29d0451e2de admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:44.688912 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1442/2916] 10.222.0.30 () {60 vars in 1144 bytes} [Tue Oct 4 12:59:44 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 12:59:44.693793 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8586-798f-4519-8467-7e576a18d844 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:44.703966 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8586-798f-4519-8467-7e576a18d844 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.709241 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3794b3-dd80-43e2-ba78-8c56f765a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.709873 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3794b3-dd80-43e2-ba78-8c56f765a646 admin admin] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.710159 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3794b3-dd80-43e2-ba78-8c56f765a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.710435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3794b3-dd80-43e2-ba78-8c56f765a646 admin admin] PATH_INFO: `/v3/roles` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.711071 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3794b3-dd80-43e2-ba78-8c56f765a646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.712673 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3794b3-dd80-43e2-ba78-8c56f765a646 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:44.722435 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1475/2917] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:44.726337 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745147-81ba-430d-ada8-c29d0451e2de admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:44.732533 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:44.736526 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745147-81ba-430d-ada8-c29d0451e2de admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.743069 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd50b1-adf1-48ac-a66b-edb8dbd378cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.743880 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd50b1-adf1-48ac-a66b-edb8dbd378cc admin admin] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.744325 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd50b1-adf1-48ac-a66b-edb8dbd378cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.744614 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd50b1-adf1-48ac-a66b-edb8dbd378cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.745453 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd50b1-adf1-48ac-a66b-edb8dbd378cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.747126 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd50b1-adf1-48ac-a66b-edb8dbd378cc admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:44.758623 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1443/2918] 10.222.0.30 () {58 vars in 1122 bytes} [Tue Oct 4 12:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 12:59:44.762648 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3794b3-dd80-43e2-ba78-8c56f765a646 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:44.772690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3794b3-dd80-43e2-ba78-8c56f765a646 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.777278 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.777952 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.778236 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.778512 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] PATH_INFO: `/v3/projects/4d622d30c51940c5a539d28d5838bcfa/users/5c75984aaef94d4f8225828ca28c2bcc/roles/bd70368fbbd7408eb37fc3ea32f7843e` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.792624 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d622d30c51940c5a539d28d5838bcfa, user_id=5c75984aaef94d4f8225828ca28c2bcc, role_id=bd70368fbbd7408eb37fc3ea32f7843e)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.795304 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:44.808584 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1476/2919] 10.222.0.30 () {60 vars in 1483 bytes} [Tue Oct 4 12:59:44 2022] PUT /identity/v3/projects/4d622d30c51940c5a539d28d5838bcfa/users/5c75984aaef94d4f8225828ca28c2bcc/roles/bd70368fbbd7408eb37fc3ea32f7843e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 12:59:44.819477 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84aef-3f22-4a70-9dd4-c4074e48e61d None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.819767 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84aef-3f22-4a70-9dd4-c4074e48e61d None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.820070 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e84aef-3f22-4a70-9dd4-c4074e48e61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.847193 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-45e84aef-3f22-4a70-9dd4-c4074e48e61d None None] MFA Rules not processed for user `5c75984aaef94d4f8225828ca28c2bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:44.848411 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-45e84aef-3f22-4a70-9dd4-c4074e48e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:44.910824 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1444/2920] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:44.922183 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:44.923856 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:44.979815 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aa2cb-f824-4a9f-a267-f0dfc0023c3d admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:44.983618 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9607-a4a6-4ce8-a757-6ec9d37e993d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdb8a57a383c475caff51c3d6d5c6a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:44.984254 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9607-a4a6-4ce8-a757-6ec9d37e993d service glance] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:44.984536 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9607-a4a6-4ce8-a757-6ec9d37e993d service glance] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:44.984811 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9607-a4a6-4ce8-a757-6ec9d37e993d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:44.993726 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9607-a4a6-4ce8-a757-6ec9d37e993d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:44.995154 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9607-a4a6-4ce8-a757-6ec9d37e993d service glance] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:45.003850 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1477/2921] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:54.907954 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=35 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:54.999926 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:59:58.389549 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e84aef-3f22-4a70-9dd4-c4074e48e61d None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:58.453660 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e84aef-3f22-4a70-9dd4-c4074e48e61d None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:58.458147 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:58.458801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:58.459054 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:58.459328 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] PATH_INFO: `/v3/users/5c75984aaef94d4f8225828ca28c2bcc` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:58.460447 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c75984aaef94d4f8225828ca28c2bcc)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:58.462398 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:58.506784 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c75984aaef94d4f8225828ca28c2bcc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:58.507984 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c75984aaef94d4f8225828ca28c2bcc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:58.515588 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c75984aaef94d4f8225828ca28c2bcc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:58.516230 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c75984aaef94d4f8225828ca28c2bcc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:58.523150 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c75984aaef94d4f8225828ca28c2bcc'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:58.540085 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1445/2922] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 12:59:58 2022] DELETE /identity/v3/users/5c75984aaef94d4f8225828ca28c2bcc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 12:59:58.544603 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699643d-2de0-4697-a92e-cbaba931f2f7 None None] REQUEST_METHOD: `POST` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:58.545086 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699643d-2de0-4697-a92e-cbaba931f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:58.545215 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699643d-2de0-4697-a92e-cbaba931f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:58.564379 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.auth.core [None req-1699643d-2de0-4697-a92e-cbaba931f2f7 None None] MFA Rules not processed for user `e178629438714f7ca1d21caf08bb5a24`. Rule list: `[]` (Enabled: `True`). {{(pid=88339) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 12:59:58.565566 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1699643d-2de0-4697-a92e-cbaba931f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:58.623371 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1478/2923] 10.222.0.30 () {58 vars in 958 bytes} [Tue Oct 4 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 12:59:58.633189 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:58.634656 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:58.691537 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4c710-0b61-431c-9ced-3d86f08b8380 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:58.695229 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150c2d-8ba8-41f7-aaaa-f5714e8e2c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:58.695861 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150c2d-8ba8-41f7-aaaa-f5714e8e2c10 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:58.696145 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150c2d-8ba8-41f7-aaaa-f5714e8e2c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:58.696422 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e150c2d-8ba8-41f7-aaaa-f5714e8e2c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:58.705541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e150c2d-8ba8-41f7-aaaa-f5714e8e2c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:58.707047 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e150c2d-8ba8-41f7-aaaa-f5714e8e2c10 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:58.716500 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1446/2924] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 12:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 12:59:58.974519 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699643d-2de0-4697-a92e-cbaba931f2f7 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 12:59:58.976547 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-1699643d-2de0-4697-a92e-cbaba931f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 12:59:58.990292 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699643d-2de0-4697-a92e-cbaba931f2f7 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 12:59:58.994964 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 12:59:58.996239 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 12:59:58.996700 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 12:59:58.996983 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] PATH_INFO: `/v3/projects/4d622d30c51940c5a539d28d5838bcfa` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 12:59:58.998138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d622d30c51940c5a539d28d5838bcfa)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 12:59:59.000147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 12:59:59.046314 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d622d30c51940c5a539d28d5838bcfa', 'request_id': 'req-8b03dfb8-eb34-44ee-ad21-21c18e817d69'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:59.051690 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d622d30c51940c5a539d28d5838bcfa', 'request_id': 'req-8b03dfb8-eb34-44ee-ad21-21c18e817d69'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:59.057741 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d622d30c51940c5a539d28d5838bcfa', 'request_id': 'req-8b03dfb8-eb34-44ee-ad21-21c18e817d69'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:59.070415 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] The token cache is being invalidate because project 4d622d30c51940c5a539d28d5838bcfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88339) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 12:59:59.070705 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:59.071328 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 12:59:59.072830 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1479/2925] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 12:59:58 2022] DELETE /identity/v3/projects/4d622d30c51940c5a539d28d5838bcfa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 13:00:08.712441 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:00:09.067195 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:00:14.382967 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150c2d-8ba8-41f7-aaaa-f5714e8e2c10 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:00:14.392341 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e150c2d-8ba8-41f7-aaaa-f5714e8e2c10 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:00:14.440460 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:00:14.441068 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:00:14.441349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:00:14.441655 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:00:14.443439 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:14.453056 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:00:14.454518 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:00:14.463016 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1447/2926] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:00:24.458760 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=26 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:00:46.648147 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:00:46.650229 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:46.662282 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03dfb8-eb34-44ee-ad21-21c18e817d69 admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:00:46.665971 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:00:46.666570 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:00:46.666857 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:00:46.667129 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:00:46.668786 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:46.678271 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:00:46.679679 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:00:46.687687 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1480/2927] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:00:46.801246 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:00:46.809948 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bff15-a778-4e5b-8bba-1ef1a9ac75a8 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:00:46.813587 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:00:46.814211 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:00:46.814495 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:00:46.814770 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:00:46.817771 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:46.828089 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:00:46.829532 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:00:46.838369 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1448/2928] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:00:46.909760 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:00:46.918385 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108cea-b066-4eba-b9ba-2ecc8fe2e11f service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:00:46.922173 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e1d9844633a4afaacbb1867b8bbe582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:00:46.922775 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:00:46.923053 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:00:46.923326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:00:46.925041 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:46.996416 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:00:46.997848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:00:47.008437 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1481/2929] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:00:47.068244 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:00:47.069670 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:47.137669 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80eccbc-09de-46d1-8920-d2aafc41d272 service neutron] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:00:47.143842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:00:47.144446 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:00:47.144722 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:00:47.144995 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:00:47.146744 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:47.158217 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:00:47.159787 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:00:47.169483 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1449/2930] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:00:49.950277 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:00:49.952352 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:49.970595 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ca687-da36-4d04-9778-78d487f73af8 service neutron] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:00:49.976848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:00:49.977917 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:00:49.978198 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:00:49.978478 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:00:49.980848 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:00:49.993337 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:00:49.995493 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:00:50.007756 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1482/2931] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:00:57.165238 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=38 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:01:00.002251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=46 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:02:05.094444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:02:05.096037 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:05.114870 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8d0d-26a4-4396-8d1e-d262919733ec service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:02:05.120757 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175bb8ec9ccf487bb6e11f37bec82cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:02:05.121370 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:05.121684 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:05.121968 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:05.124122 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:05.140091 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:02:05.142102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:02:05.155673 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1450/2932] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:02:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:02:12.759192 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:02:12.776685 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6c113-03e3-4198-b77e-f13c52c5ea84 service nova] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:02:12.781855 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09336606-504f-4d5f-b210-0df2e3ed6bf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:02:12.782738 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09336606-504f-4d5f-b210-0df2e3ed6bf2 service placement] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:12.782866 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09336606-504f-4d5f-b210-0df2e3ed6bf2 service placement] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:12.783040 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09336606-504f-4d5f-b210-0df2e3ed6bf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:12.784762 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-09336606-504f-4d5f-b210-0df2e3ed6bf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:12.798171 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09336606-504f-4d5f-b210-0df2e3ed6bf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:02:12.800143 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09336606-504f-4d5f-b210-0df2e3ed6bf2 service placement] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:02:12.816643 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1483/2933] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:02:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:02:15.149581 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=6 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:02:15.617458 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:02:15.631639 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894732f-0e8c-44c3-94c4-cd135382474f service nova] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:02:15.654368 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f81ab6-67a2-4bcf-bed2-ea8bb1e4d56a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:02:15.655348 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f81ab6-67a2-4bcf-bed2-ea8bb1e4d56a service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:15.657182 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f81ab6-67a2-4bcf-bed2-ea8bb1e4d56a service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:15.657714 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f81ab6-67a2-4bcf-bed2-ea8bb1e4d56a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:15.662067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-c7f81ab6-67a2-4bcf-bed2-ea8bb1e4d56a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:15.695382 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f81ab6-67a2-4bcf-bed2-ea8bb1e4d56a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:02:15.698311 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f81ab6-67a2-4bcf-bed2-ea8bb1e4d56a service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:02:15.712297 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1451/2934] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 13:02:15.863398 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9c31-53e7-4608-8dbd-ec34e662c894 None None] REQUEST_METHOD: `GET` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:15.864448 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9c31-53e7-4608-8dbd-ec34e662c894 None None] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:15.865034 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b9c31-53e7-4608-8dbd-ec34e662c894 None None] PATH_INFO: `/` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:15.868777 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1484/2935] 10.222.0.30 () {54 vars in 961 bytes} [Tue Oct 4 13:02:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 13:02:15.876169 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316779ab-58fb-4275-a490-ce3022f4fac8 None None] REQUEST_METHOD: `POST` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:15.877541 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316779ab-58fb-4275-a490-ce3022f4fac8 None None] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:15.878694 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316779ab-58fb-4275-a490-ce3022f4fac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:15.927101 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.auth.core [None req-316779ab-58fb-4275-a490-ce3022f4fac8 None None] MFA Rules not processed for user `2243f5d37f1443e1a3d6fc7a8eadb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 13:02:15.928602 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-316779ab-58fb-4275-a490-ce3022f4fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:15.937640 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b9c31-53e7-4608-8dbd-ec34e662c894 None None] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:02:15.939764 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-702b9c31-53e7-4608-8dbd-ec34e662c894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:15.945349 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1452/2936] 10.222.0.30 () {58 vars in 1058 bytes} [Tue Oct 4 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 13:02:15.955006 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316779ab-58fb-4275-a490-ce3022f4fac8 None None] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:02:15.967842 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316779ab-58fb-4275-a490-ce3022f4fac8 None None] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:02:15.974650 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2243f5d37f1443e1a3d6fc7a8eadb46c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ddc76b49714ed489f4127ea049425b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:02:15.975338 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] REQUEST_METHOD: `GET` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:15.975700 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:15.976408 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:15.978627 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:15.994605 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:02:15.996413 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:02:16.008102 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1453/2937] 10.222.0.30 () {60 vars in 1365 bytes} [Tue Oct 4 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 13:02:16.032368 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b9c31-53e7-4608-8dbd-ec34e662c894 None None] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:02:16.037590 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:02:16.038320 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:16.038530 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:16.038805 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] PATH_INFO: `/v3/users/f5c53dfe621342a2a1f0277625820656` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:16.040007 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c53dfe621342a2a1f0277625820656)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:02:16.042042 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:02:16.087943 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c53dfe621342a2a1f0277625820656'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.088568 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c53dfe621342a2a1f0277625820656'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.095326 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c53dfe621342a2a1f0277625820656'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.095979 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c53dfe621342a2a1f0277625820656'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.107649 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c53dfe621342a2a1f0277625820656'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.122444 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1485/2938] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 13:02:15 2022] DELETE /identity/v3/users/f5c53dfe621342a2a1f0277625820656 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 13:02:16.301512 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:02:16.314066 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24ef58-a8b4-4c11-b611-f08f9040be1d service placement] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:02:16.372890 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:02:16.373524 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:16.373837 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:16.374111 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] PATH_INFO: `/v3/projects/26bce8f5d80645e28d56f69efe77773e` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:16.375218 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bce8f5d80645e28d56f69efe77773e)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:02:16.377155 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:02:16.422168 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bce8f5d80645e28d56f69efe77773e', 'request_id': 'req-398b536b-4389-4a52-a42e-69e081cd87e8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.427622 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bce8f5d80645e28d56f69efe77773e', 'request_id': 'req-398b536b-4389-4a52-a42e-69e081cd87e8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.435666 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bce8f5d80645e28d56f69efe77773e', 'request_id': 'req-398b536b-4389-4a52-a42e-69e081cd87e8'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.447415 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] The token cache is being invalidate because project 26bce8f5d80645e28d56f69efe77773e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 13:02:16.447703 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.448326 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.449851 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1454/2939] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 13:02:16 2022] DELETE /identity/v3/projects/26bce8f5d80645e28d56f69efe77773e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 13:02:16.454022 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] Authenticating user token {{(pid=88339) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:02:16.455621 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.fernet_utils [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88339) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:16.469788 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6a570-b60c-4604-830d-8c3235b9460c admin admin] Validating token access rules against request {{(pid=88339) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:02:16.529027 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88339) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:02:16.529686 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:16.529974 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] SCRIPT_NAME: `/identity` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:16.530251 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] PATH_INFO: `/v3/users/80d8be00e17c417bac1b6ab479585eff` {{(pid=88339) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:16.531390 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d8be00e17c417bac1b6ab479585eff)` {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:02:16.533311 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] RBAC: Authorization granted {{(pid=88339) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:02:16.538622 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:02:16.579798 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d8be00e17c417bac1b6ab479585eff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.580439 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d8be00e17c417bac1b6ab479585eff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.587138 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d8be00e17c417bac1b6ab479585eff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.587789 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d8be00e17c417bac1b6ab479585eff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.599327 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG keystone.notifications [None req-5a77579b-c4ba-4c0b-a337-3d3ba464985f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d8be00e17c417bac1b6ab479585eff'} {{(pid=88339) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.612384 dv-cinder-860244-1-smb devstack@keystone.service[88339]: [pid: 88339|app: 0|req: 1486/2940] 10.222.0.30 () {58 vars in 1224 bytes} [Tue Oct 4 13:02:16 2022] DELETE /identity/v3/users/80d8be00e17c417bac1b6ab479585eff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 13:02:16.779134 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] Authenticating user token {{(pid=88338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 13:02:16.780647 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.fernet_utils [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 13:02:16.793864 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b536b-4389-4a52-a42e-69e081cd87e8 admin admin] Validating token access rules against request {{(pid=88338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 13:02:16.834830 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:02:16.851801 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e178629438714f7ca1d21caf08bb5a24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71839b182c07466f9bb5d0732665873b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 13:02:16.852545 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 13:02:16.852826 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 13:02:16.853720 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] PATH_INFO: `/v3/projects/d0ea90e14b924b269a1d9c898d116495` {{(pid=88338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 13:02:16.854874 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ea90e14b924b269a1d9c898d116495)` {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 13:02:16.856814 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] RBAC: Authorization granted {{(pid=88338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 13:02:16.901444 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ea90e14b924b269a1d9c898d116495', 'request_id': 'req-aa7d30d1-1119-431d-882a-5cc1bdc57423'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.906981 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ea90e14b924b269a1d9c898d116495', 'request_id': 'req-aa7d30d1-1119-431d-882a-5cc1bdc57423'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.913829 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ea90e14b924b269a1d9c898d116495', 'request_id': 'req-aa7d30d1-1119-431d-882a-5cc1bdc57423'} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.925094 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] The token cache is being invalidate because project d0ea90e14b924b269a1d9c898d116495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 13:02:16.925389 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.926067 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG keystone.notifications [None req-aa7d30d1-1119-431d-882a-5cc1bdc57423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 13:02:16.927555 dv-cinder-860244-1-smb devstack@keystone.service[88338]: [pid: 88338|app: 0|req: 1455/2941] 10.222.0.30 () {58 vars in 1233 bytes} [Tue Oct 4 13:02:16 2022] DELETE /identity/v3/projects/d0ea90e14b924b269a1d9c898d116495 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 13:02:26.608753 dv-cinder-860244-1-smb devstack@keystone.service[88339]: DEBUG dbcounter [-] [88339] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 13:02:26.922262 dv-cinder-860244-1-smb devstack@keystone.service[88338]: DEBUG dbcounter [-] [88338] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}